2026-01-10 17:00:08 [scrapy.utils.log] (PID: 62) INFO: Scrapy 2.12.0 started (bot: catalog_extraction)
2026-01-10 17:00:08 [scrapy.utils.log] (PID: 62) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36
2026-01-10 17:00:08 [global_industrial] (PID: 62) INFO: Starting extraction spider global_industrial...
2026-01-10 17:00:08 [scrapy.addons] (PID: 62) INFO: Enabled addons:
[]
2026-01-10 17:00:08 [py.warnings] (PID: 62) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting.
It will be removed in a future version of Scrapy.
  return cls(crawler)

2026-01-10 17:00:08 [scrapy.extensions.telnet] (PID: 62) INFO: Telnet Password: f6f273d858bf2db0
2026-01-10 17:00:08 [py.warnings] (PID: 62) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2026-01-10 17:00:09 [scrapy.middleware] (PID: 62) INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.closespider.CloseSpider',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'spidermon.contrib.scrapy.extensions.Spidermon']
2026-01-10 17:00:09 [scrapy.crawler] (PID: 62) INFO: Overridden settings:
{'BOT_NAME': 'catalog_extraction',
 'CONCURRENT_ITEMS': 250,
 'DOWNLOAD_DELAY': 0.5,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/global_industrial/cfe1e38aee4511f0aae84200a9fe0102.log',
 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: '
               '%(message)s',
 'LOG_LEVEL': 'INFO',
 'NEWSPIDER_MODULE': 'catalog_extraction.spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['catalog_extraction.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': None}
2026-01-10 17:00:09 [scrapy_poet.injection] (PID: 62) INFO: Loading providers:
 [<class 'scrapy_poet.page_input_providers.HttpRequestProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpResponseProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpClientProvider'>,
 <class 'scrapy_poet.page_input_providers.PageParamsProvider'>,
 <class 'scrapy_poet.page_input_providers.RequestUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.ResponseUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.StatsProvider'>]
2026-01-10 17:00:09 [scrapy.middleware] (PID: 62) INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware',
 'scrapy_poet.InjectionMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy_poet.DownloaderStatsMiddleware']
2026-01-10 17:00:09 [NotFoundHandlerSpiderMiddleware] (PID: 62) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment.
2026-01-10 17:00:09 [scrapy.middleware] (PID: 62) INFO: Enabled spider middlewares:
['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware',
 'catalog_extraction.middlewares.FixtureSavingMiddleware',
 'scrapy_poet.RetryMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-01-10 17:00:09 [scrapy.middleware] (PID: 62) INFO: Enabled item pipelines:
['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline',
 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline',
 'catalog_extraction.pipelines.PriceRoundingPipeline',
 'scraping_utils.pipelines.AttachSupplierPipeline',
 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline']
2026-01-10 17:00:09 [scrapy.core.engine] (PID: 62) INFO: Spider opened
2026-01-10 17:00:09 [scrapy.extensions.closespider] (PID: 62) INFO: Spider will stop when no items are produced after 1800 seconds.
2026-01-10 17:00:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-10 17:00:09 [scrapy.extensions.telnet] (PID: 62) INFO: Telnet console listening on 127.0.0.1:6024
2026-01-10 17:00:15 [ProxyManagerDownloaderMiddleware] (PID: 62) INFO: Using brd-customer-hl_13cda1e4-zone-main_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware.
2026-01-10 17:00:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-stp-steel-safe-roll-lad-wgt-act-lock-24-w-exp-stp-org-wa093214x-o>: HTTP status code is not handled or not allowed
2026-01-10 17:00:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21503-z-large-sump-roof-drain-poly-dome-and-3-no-hub-outlet>: HTTP status code is not handled or not allowed
2026-01-10 17:00:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dividers-for-6-inch-h-drawer-of-global-modular-drawer-cabinet-36-w-x-24-d-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:00:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stiebel-eltron-mini-3-3-0-kw-point-of-use-tankless-electric-water-heater-120v>: HTTP status code is not handled or not allowed
2026-01-10 17:00:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9in-x-3-8in-100-polyester-roller-cover-with-a-14in-cage-frame-24-case-914-ap038>: HTTP status code is not handled or not allowed
2026-01-10 17:00:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enapc-eco-ibc-bin-sump-only>: HTTP status code is not handled or not allowed
2026-01-10 17:00:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kenda-loadstar-trailer-tire-4-hole-wheel-4-4-480-400-8-lrb>: HTTP status code is not handled or not allowed
2026-01-10 17:00:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truck-lid-rmtt150lid-1-1-2-cu-yd>: HTTP status code is not handled or not allowed
2026-01-10 17:00:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7550d-dura-polyurethane-chair-aluminum-base-mushroom-glides-black>: HTTP status code is not handled or not allowed
2026-01-10 17:00:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eagle-professional-grade-38-air-ratchet-wrench-ega200>: HTTP status code is not handled or not allowed
2026-01-10 17:00:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/riser-straight-with-carpet-96l-x-18w-x-32h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:00:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-wall-tray-for-precision-shaking-water-baths>: HTTP status code is not handled or not allowed
2026-01-10 17:00:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8ab-x-1-2-security-self-drilling-screw-pan-6-lobe-head-410-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:00:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sewn-liquid-bag-filter-polyester-multifilament-7-1-8-x-32-150-micron-plastic-flange-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 17:00:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8ab-x-1-2-security-sheet-metal-screw-button-torx-head-18-8-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:00:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-32-x-3-8-one-way-machine-screw-truss-head-18-8-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:00:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-32-hex-l-wrench-short-13809>: HTTP status code is not handled or not allowed
2026-01-10 17:00:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sewn-liquid-bag-filter-polyester-felt-5-1-2-d-x-31-l-5-micron-steel-ring-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 17:00:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-liquid-bag-filter-polypropylene-felt-7-1-8-x-16-1-2-100-micron-plastic-flange-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 17:00:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5mm-hex-tamper-resistant-l-wrench-48364>: HTTP status code is not handled or not allowed
2026-01-10 17:00:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/19-7-8-x-41-7-8-x-17-1-2-rack-bin-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:00:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-1-2-x-41-7-8-x-17-1-2-rack-bin-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:00:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-18-breakaway-nut-non-removable-aluminum-made-in-usa-pkg-of-50>: HTTP status code is not handled or not allowed
2026-01-10 17:00:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m6-spanner-nut-zinc-alloy-made-in-usa-pkg-of-50>: HTTP status code is not handled or not allowed
2026-01-10 17:00:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-27-tamperproof-torx-power-bit>: HTTP status code is not handled or not allowed
2026-01-10 17:00:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-18-x-2-one-way-machine-screw-round-head-18-8-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:00:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-tamperproof-spanner-bit-5-16-hex-shank>: HTTP status code is not handled or not allowed
2026-01-10 17:00:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-tamperproof-spanner-bit-1-4-hex-shank>: HTTP status code is not handled or not allowed
2026-01-10 17:00:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/soap-refl-nat-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:00:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ice-block-one-gallon>: HTTP status code is not handled or not allowed
2026-01-10 17:00:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a19adc-31c-remote-bulb-temperature-control>: HTTP status code is not handled or not allowed
2026-01-10 17:00:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tripod-stand-dt15s25t43-for-15-oaw-skatewheel-adj-25-to-43h>: HTTP status code is not handled or not allowed
2026-01-10 17:00:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a19qsc-1c-remote-bulb-temperature-control>: HTTP status code is not handled or not allowed
2026-01-10 17:00:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-male-branch-tee-metal-release-collet-1-4-tube-x-10-32-unf>: HTTP status code is not handled or not allowed
2026-01-10 17:00:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelving-48w-x-18d-x-14h-1-shelf-add-on-chrome>: HTTP status code is not handled or not allowed
2026-01-10 17:00:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-8-bspp-poly-muffler-145-psi-75-micron-5-to-212-f>: HTTP status code is not handled or not allowed
2026-01-10 17:00:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0387122-2-vacuum-breaker>: HTTP status code is not handled or not allowed
2026-01-10 17:00:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0386447-3-4-vacuum-breaker>: HTTP status code is not handled or not allowed
2026-01-10 17:00:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nilfisk-gm-80-complete-hose-with-steel-wand>: HTTP status code is not handled or not allowed
2026-01-10 17:00:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8n10p05a-set-screw-w-full-ball-m8-x-125-thread-10mm-thread-length>: HTTP status code is not handled or not allowed
2026-01-10 17:00:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adaptor-elbow-bspp-female-x-female-3-8>: HTTP status code is not handled or not allowed
2026-01-10 17:00:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultradrain-rectangular-seal-36inches-x-58inches>: HTTP status code is not handled or not allowed
2026-01-10 17:00:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelving-36w-x-18d-x-34h-2-shelf-add-on-chrome>: HTTP status code is not handled or not allowed
2026-01-10 17:00:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelving-72w-x-24d-x-34h-2-shelf-add-on-chrome>: HTTP status code is not handled or not allowed
2026-01-10 17:00:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/i-poly-15-multipoint-stirrer-15-position-130-990-rpm-100-240v>: HTTP status code is not handled or not allowed
2026-01-10 17:00:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/komet-stir-bar-50-round-21mm-dia-x-50mm-l-1-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:01:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orange-tint-3-wall-style-specimen-trans-bag-prnt-bio-6w-9l>: HTTP status code is not handled or not allowed
2026-01-10 17:01:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelving-54w-x-14d-x-63h-4-shelf-add-on-chrome>: HTTP status code is not handled or not allowed
2026-01-10 17:01:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-48-x-36-adj-height-workbench-w-drawer-riser-gray-maple-safety-edge-top>: HTTP status code is not handled or not allowed
2026-01-10 17:01:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-assembled-walker-commode-cover-on-roll-24w-48l>: HTTP status code is not handled or not allowed
2026-01-10 17:01:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-mild-foam-hand-wash-1200ml-refill-unscented-2-refills-case>: HTTP status code is not handled or not allowed
2026-01-10 17:01:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-step-plastic-step-stand-long-blue-66-12-w-x-26-12-d-x-10-h-nlst-1-bl>: HTTP status code is not handled or not allowed
2026-01-10 17:01:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-equipment-cover-clear-on-roll-38w-48l>: HTTP status code is not handled or not allowed
2026-01-10 17:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/rack_accessories/bulk_storage_rack_shelves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:01:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-panels-powdercoat-silver-16-x-32-2-pc>: HTTP status code is not handled or not allowed
2026-01-10 17:01:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 90 pages (at 90 pages/min), scraped 36 items (at 36 items/min)
2026-01-10 17:01:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-shelves-galvanized-3-x-48-2-pc>: HTTP status code is not handled or not allowed
2026-01-10 17:01:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-tool-cart-galvanized-48-x-16>: HTTP status code is not handled or not allowed
2026-01-10 17:01:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1791500-pm1500-3hp-1ph-230v-bandsaw>: HTTP status code is not handled or not allowed
2026-01-10 17:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/rack_accessories/bulk_storage_rack_shelves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:01:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-plate-platform-kit-4-x-18-x-54>: HTTP status code is not handled or not allowed
2026-01-10 17:01:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-coil-thread-repair-kit-for-metal-m4-07-x-15d>: HTTP status code is not handled or not allowed
2026-01-10 17:01:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-coil-thread-repair-kit-for-metal-m8-10-x-15d>: HTTP status code is not handled or not allowed
2026-01-10 17:01:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-value-max-locker-12-w-x-12-d-x-78-h-725-hallowell-gray-triple-tier-1-wide-assembled>: HTTP status code is not handled or not allowed
2026-01-10 17:01:18 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/utility_racks/rack_accessories/bulk_storage_rack_shelves> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/utility_racks/rack_accessories/bulk_storage_rack_shelves landed on page that is not a product page.
2026-01-10 17:01:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/economy-coil-thread-repair-kit-for-metal-m3-05-x-15d>: HTTP status code is not handled or not allowed
2026-01-10 17:01:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-48-w-x-24-d-x-96-h-add-on-3-shelf-levels-wood-deck-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/legacy-60-single-pedestal-desk-ash-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:01:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/legacy-stand-up-2-storage-cabinet-lateral-file-desk-quad-with-bookcase-end-ash-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:01:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-72-w-x-24-d-x-96-h-starter-3-shelf-levels-wood-deck-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:24 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/utility_racks/rack_accessories/bulk_storage_rack_shelves> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/utility_racks/rack_accessories/bulk_storage_rack_shelves landed on page that is not a product page.
2026-01-10 17:01:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-series-wheel-5000084592-ws-8-x-2-performa-rubber-1-2-straight-roller-bearing>: HTTP status code is not handled or not allowed
2026-01-10 17:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:01:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-96-w-x-48-d-x-84-h-starter-3-shelf-levels-wood-deck-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-series-wheel-500006459-ws-6-x-2-performa-rubber-1-2-straight-roller-bearing-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-hi-tech-metal-bin-shelving-36-w-x-12-d-x-87-h-725-hallowell-gray-add-on-unit-24-bins>: HTTP status code is not handled or not allowed
2026-01-10 17:01:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-72-w-x-48-d-x-96-h-starter-3-shelf-levels-wood-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ga7vsd-10-hp-variable-speed-rotary-screw-compressor-tankless-175-psig-3-phase-200v>: HTTP status code is not handled or not allowed
2026-01-10 17:01:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-48-w-x-48-d-x-120-h-add-on-3-shelf-levels-steel-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alera-chsngl-single-sided-partition-garment-hook-silver-steel-2pk>: HTTP status code is not handled or not allowed
2026-01-10 17:01:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1031161-orifice-hex-32-lp-for-ultrafryer>: HTTP status code is not handled or not allowed
2026-01-10 17:01:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fort-knox-rivetwell-extra-level-with-particle-board-deck-36-w-x-24-d-x-3375-h-red-1-level-1>: HTTP status code is not handled or not allowed
2026-01-10 17:01:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelf-level-for-bulk-storage-rack-48-w-x-36-d-wood-deck-sand>: HTTP status code is not handled or not allowed
2026-01-10 17:01:36 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks landed on page that is not a product page.
2026-01-10 17:01:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nitrile-coated-nylon-gloves-large>: HTTP status code is not handled or not allowed
2026-01-10 17:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:01:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ribbed-4-step-18-alum-rolling-ladder-10-top-step-spring-load-a4sh>: HTTP status code is not handled or not allowed
2026-01-10 17:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/laundry_detergent already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:01:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-96-w-x-36-d-x-96-h-add-on-3-shelf-levels-wood-deck-sand>: HTTP status code is not handled or not allowed
2026-01-10 17:01:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010715-radiant-for-american-range>: HTTP status code is not handled or not allowed
2026-01-10 17:01:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-72-w-x-48-d-x-120-h-starter-3-shelf-levels-wire-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ironwood-75-Open-folio-storage-folkstone>: HTTP status code is not handled or not allowed
2026-01-10 17:01:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-navy-flag-3x5-nylon>: HTTP status code is not handled or not allowed
2026-01-10 17:01:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-96-w-x-24-d-x-84-h-starter-3-shelf-levels-steel-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelf-level-for-bulk-storage-rack-48-w-x-36-d-wood-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1781010-label-inch-iced-tea-inch-for-wilbur-curtis-co>: HTTP status code is not handled or not allowed
2026-01-10 17:01:47 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks landed on page that is not a product page.
2026-01-10 17:01:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/laundry_detergent>: HTTP status code is not handled or not allowed
2026-01-10 17:01:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/561562-deck-mount-faucet-economy-w-6-inch-spout>: HTTP status code is not handled or not allowed
2026-01-10 17:01:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-48-w-x-48-d-x-120-h-add-on-3-shelf-levels-wood-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/85-1130-pink-extra-thick-ptfe-teflon-tape-1-2-inch-x-260-inch>: HTTP status code is not handled or not allowed
2026-01-10 17:01:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelf-level-for-bulk-storage-rack-96-w-x-24-d-wire-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:01:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/441614-contactor-2p-40-50a-24v>: HTTP status code is not handled or not allowed
2026-01-10 17:01:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012251-operating-stem-assembly-for-cleveland-range>: HTTP status code is not handled or not allowed
2026-01-10 17:01:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-40-14w-drawer-cabinet5-drawer51-compart-classic-blue-individual-lock>: HTTP status code is not handled or not allowed
2026-01-10 17:01:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/original-exercise-station-pulley-attachment->: HTTP status code is not handled or not allowed
2026-01-10 17:01:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/first-aid-only-1001-fae-0103-large-first-aid-kit-209-pieces-osha-compliant-plastic-case>: HTTP status code is not handled or not allowed
2026-01-10 17:02:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curad-cur45881-alcohol-swabs-1-x-1-200box>: HTTP status code is not handled or not allowed
2026-01-10 17:02:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-40-14w-cabinet-15-drawer-243-compart-light-gray-individual-lock>: HTTP status code is not handled or not allowed
2026-01-10 17:02:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/38-1437-13-32-inch-x-1-1-2-inch-6a-fast-acting-ktk-6-glass-fuse-600v>: HTTP status code is not handled or not allowed
2026-01-10 17:02:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-40-14w-drawer-cabinet-4-drawer-24-compart-bright-blue-no-lock>: HTTP status code is not handled or not allowed
2026-01-10 17:02:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012231-elbow-oring-boss-90deg2062-6-4s-for-cleveland-range>: HTTP status code is not handled or not allowed
2026-01-10 17:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/wiring_devices/wire_clips_clamps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:02:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8014062-magnetron-toshiba>: HTTP status code is not handled or not allowed
2026-01-10 17:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:02:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-inch-low-velocity-exhaust-shutter>: HTTP status code is not handled or not allowed
2026-01-10 17:02:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tin-plated-copper-butt-splice-6655-050-2-0-gauge-50-pcs>: HTTP status code is not handled or not allowed
2026-01-10 17:02:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 182 pages (at 92 pages/min), scraped 73 items (at 37 items/min)
2026-01-10 17:02:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/garden-tractor-terminal-protector-5710-050b-black-50-pcs>: HTTP status code is not handled or not allowed
2026-01-10 17:02:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-174-restaurant-lunchroom-square-bar-height-table-42-x-42-x-42-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:02:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5051003-motor-fan-115v-for-bohn-refrigeration>: HTTP status code is not handled or not allowed
2026-01-10 17:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:02:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-polythnene-split-loom-505207-100-5-8-id-100-ft>: HTTP status code is not handled or not allowed
2026-01-10 17:02:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-inplant-office-w-2-windows-class-a-8-w-x-16-d-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:02:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/wiring_devices/wire_clips_clamps>: HTTP status code is not handled or not allowed
2026-01-10 17:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/cable_management/cable_tie_tools already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:02:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps>: HTTP status code is not handled or not allowed
2026-01-10 17:02:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/263785-leveler-cushion-glide>: HTTP status code is not handled or not allowed
2026-01-10 17:02:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/263836-cap-end-square-tubing>: HTTP status code is not handled or not allowed
2026-01-10 17:02:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-steel-cart-2-tray-shelves-18-x-30>: HTTP status code is not handled or not allowed
2026-01-10 17:02:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-powder-exercise-band-black-25-yard-roll-1-roll-box>: HTTP status code is not handled or not allowed
2026-01-10 17:02:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps>: HTTP status code is not handled or not allowed
2026-01-10 17:02:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exercise-band-green-48-l-band-box-of-40>: HTTP status code is not handled or not allowed
2026-01-10 17:02:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conntek-14303-36-50-amp-rv-camp-power-cord-with-nema-14-50p-male-plug-to-bare-wire>: HTTP status code is not handled or not allowed
2026-01-10 17:02:27 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/cable_management/cable_tie_tools> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/cable_management/cable_tie_tools landed on page that is not a product page.
2026-01-10 17:02:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-free-exercise-band-blue-6-yard-roll-1-roll-box>: HTTP status code is not handled or not allowed
2026-01-10 17:02:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-124-d-incandescent-lampholder-medium-base-single-circuit-660w-250v>: HTTP status code is not handled or not allowed
2026-01-10 17:02:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-23452-h-snap-in-lamp-support-clip-for-horiz-2g11-base-twin-tube-fluorescent-lampholder>: HTTP status code is not handled or not allowed
2026-01-10 17:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/door_window_hardware/locksets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:02:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010545-grate-broiler-for-garland-range>: HTTP status code is not handled or not allowed
2026-01-10 17:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/door_window_hardware/exit_devices already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:02:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bungee-exercise-cord-with-attachments-4-cord-black>: HTTP status code is not handled or not allowed
2026-01-10 17:02:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exercise-band-loop-30-long-silver>: HTTP status code is not handled or not allowed
2026-01-10 17:02:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/321955-silicone-tubing-foot-for-hoshizaki-of-america>: HTTP status code is not handled or not allowed
2026-01-10 17:02:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-1678-pilot-orifice-0010-inch-hole-liquid-propane-size-cct--1-4-inch-5-16-inch-32-thread>: HTTP status code is not handled or not allowed
2026-01-10 17:02:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-exercise-band-6-yard-roll-box-5-color-set>: HTTP status code is not handled or not allowed
2026-01-10 17:02:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6400md5-32-oz-metal-detectable-hand-scoop-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:02:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-exercise-band-tan-50-yard-roll-box>: HTTP status code is not handled or not allowed
2026-01-10 17:02:40 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/fasteners/door_window_hardware/locksets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/fasteners/door_window_hardware/locksets landed on page that is not a product page.
2026-01-10 17:02:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-1880-stainless-steel-shelf-support>: HTTP status code is not handled or not allowed
2026-01-10 17:02:41 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/fasteners/door_window_hardware/exit_devices> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/fasteners/door_window_hardware/exit_devices landed on page that is not a product page.
2026-01-10 17:02:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seapro-purofort-non-safety-boots-metal-midsole-size-7-sea-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:02:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylinder-tube-rack-2-wide-x-3-deep-30w-x-38d-x-30h6-cylinder-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:02:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-welded-frame-mirror-18-w-x-36-h>: HTTP status code is not handled or not allowed
2026-01-10 17:02:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/98024-1-5-color-coding-rubber-band-x5-red>: HTTP status code is not handled or not allowed
2026-01-10 17:02:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-shelf-liner-72w-x-18d-white>: HTTP status code is not handled or not allowed
2026-01-10 17:02:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1111292-aerator-22gpm-vandal-resist-for-ts-brass-bronze-works>: HTTP status code is not handled or not allowed
2026-01-10 17:02:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/281095-inside-release>: HTTP status code is not handled or not allowed
2026-01-10 17:02:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-32-x-1-machine-screw-flat-head-slotted-steel-zinc-ft-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:02:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-matrixseries-surface-mounted-multi-roll-tissue-dispenser>: HTTP status code is not handled or not allowed
2026-01-10 17:02:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5001010-relay-starter-36a-for-manitowoc-machines>: HTTP status code is not handled or not allowed
2026-01-10 17:02:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-18-x-6-machine-screw-round-head-slotted-steel-zinc-ft-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:02:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/needle-roller-cage-assembly-18mm-bore-22mm-od-10mm-w-steel-cage-material>: HTTP status code is not handled or not allowed
2026-01-10 17:02:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20-x-3-machine-screw-flat-head-phillips-steel-zinc-ft-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:02:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6962md2-4-metal-detectable-scraper-green>: HTTP status code is not handled or not allowed
2026-01-10 17:02:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-threaded-handle-0160-1516-x-60>: HTTP status code is not handled or not allowed
2026-01-10 17:02:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelate-wire-shelf-truck-72x18x69-1200-pound-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:03:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-12-x-72-phenolic-locker-single-tier-dove-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:03:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/29605-51-ultra-hygiene-handle-white>: HTTP status code is not handled or not allowed
2026-01-10 17:03:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/justrite-drum-lock-set-plastic-drums>: HTTP status code is not handled or not allowed
2026-01-10 17:03:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/line-voltage-thermostat-single-pole-heat-only-aet9swts>: HTTP status code is not handled or not allowed
2026-01-10 17:03:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-w-x-36-d-production-workbench-esd-laminate-safety-edge-complete-bench-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:03:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-wire-shelf-truck-36x24x69-1200-pound-capacity-with-brakes-1>: HTTP status code is not handled or not allowed
2026-01-10 17:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/wire_cable/electrical_wire_cable already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:03:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/85-1063-ignition-terminal-female-spark-plug-end>: HTTP status code is not handled or not allowed
2026-01-10 17:03:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conductive-churn-brush-10-4-5in-black-c10546>: HTTP status code is not handled or not allowed
2026-01-10 17:03:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/261228-orifice-67>: HTTP status code is not handled or not allowed
2026-01-10 17:03:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 277 pages (at 95 pages/min), scraped 114 items (at 41 items/min)
2026-01-10 17:03:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/innovera-compatible-remanufactured-ch562wn-61-ink-165-page-yield-tri-color>: HTTP status code is not handled or not allowed
2026-01-10 17:03:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-wire-shelf-truck-48x18x81-1600-pound-capacity-1>: HTTP status code is not handled or not allowed
2026-01-10 17:03:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-static-broom-base-only-19-1-2in-black-c26155>: HTTP status code is not handled or not allowed
2026-01-10 17:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_tools/brushes_sponges_squeegees/cleaning_brushes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:03:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2941032-torque-master-reversible-for-anthony-international-california>: HTTP status code is not handled or not allowed
2026-01-10 17:03:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durapan-light-gauge-two-thirds-size-pan-13-7-8-x-12-3-4-607232>: HTTP status code is not handled or not allowed
2026-01-10 17:03:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/wire_cable/electrical_wire_cable>: HTTP status code is not handled or not allowed
2026-01-10 17:03:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duct-access-door-with-no-hinge-18-x-18>: HTTP status code is not handled or not allowed
2026-01-10 17:03:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011595-knob-for-vulcan-hart>: HTTP status code is not handled or not allowed
2026-01-10 17:03:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-w-x-36-d-production-workbench-phenolic-resin-safety-edge-complete-bench-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:03:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2051270-washer-worm-wheel-shaft-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 17:03:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-flush-access-door-24-x-36>: HTTP status code is not handled or not allowed
2026-01-10 17:03:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_tools/brushes_sponges_squeegees/cleaning_brushes>: HTTP status code is not handled or not allowed
2026-01-10 17:03:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/-replacement-media-set-for-apex153-4000-60w-x-8d-x-49-12h>: HTTP status code is not handled or not allowed
2026-01-10 17:03:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1211142-tip-crutch-f-1-1-4-inch-tube-blk>: HTTP status code is not handled or not allowed
2026-01-10 17:03:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/263659-ferrule-brass-7-16-inch-20-pkg>: HTTP status code is not handled or not allowed
2026-01-10 17:03:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/29587-50-basic-aluminum-handle-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:03:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/29606-51-ultra-hygiene-handle-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:03:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-96x42x120-add-on-unit-green-orange-4000-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:03:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/41867-long-handle-scrubbing-brush-stiff-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:03:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6231014-screw-phlp-10-24thd-stainless-steel-25pk>: HTTP status code is not handled or not allowed
2026-01-10 17:03:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-mesh-security-cage-36x24x60>: HTTP status code is not handled or not allowed
2026-01-10 17:03:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40122-nylon-scraper-with-threaded-handle-green>: HTTP status code is not handled or not allowed
2026-01-10 17:03:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2171190-knob-caramel-for-server-products>: HTTP status code is not handled or not allowed
2026-01-10 17:03:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dinex-filigree-design-cutlery-caddy-16-x-16-600-cuss>: HTTP status code is not handled or not allowed
2026-01-10 17:03:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/41968-ust-long-handle-scrubbing-brush-stiff-purple>: HTTP status code is not handled or not allowed
2026-01-10 17:03:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dinex-insulated-base-for-insulated-domes-9-1-2-d-12-cs-onyx-dx107703>: HTTP status code is not handled or not allowed
2026-01-10 17:03:39 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits landed on page that is not a product page.
2026-01-10 17:03:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-vi-wind-front-brim-safety-helmet-adjustable-one-d-rotor-clamping-system-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:03:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conntek-20241-025-25-sjtw-14-3-outdoor-extension-cord-with-nema-5-15p-r>: HTTP status code is not handled or not allowed
2026-01-10 17:03:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forkli-able-shipping-container-with-lid-42-x-42-8>: HTTP status code is not handled or not allowed
2026-01-10 17:03:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forkli-able-shipping-container-49-x-21-without-lid-1>: HTTP status code is not handled or not allowed
2026-01-10 17:03:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gravity-carton-flow-roller-track-kit-1>: HTTP status code is not handled or not allowed
2026-01-10 17:03:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-sectional-stackbin-unit-37-w-x-24-d-x-11-h-black-2-compartments>: HTTP status code is not handled or not allowed
2026-01-10 17:03:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indoor-outdoor-quartz-electric-infrared-heater-och-57-208v-sse-208v-3000w-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:03:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/americana-climbing-wind-safety-helmet-type-2-4-point-ratchet-suspension-hi-viz-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:03:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stretch-unlined-bib-overall-l-black>: HTTP status code is not handled or not allowed
2026-01-10 17:03:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-tube-2-x-050-x-4-polished-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:03:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/45-compartment-sectional-unit-37-w-x-13-d-x-54-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:03:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-compartment-steel-sectional-unit-37-w-x-24-d-x-33-h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:03:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/28-compartment-multi-size-sectional-unit-37-w-x-24-d-x-53-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:03:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/221204-dial-2-d-off-550-200>: HTTP status code is not handled or not allowed
2026-01-10 17:03:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/74-h-nexel-chrome-wire-shelving-60-w-x-14-d>: HTTP status code is not handled or not allowed
2026-01-10 17:03:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insulated-safety-bib-overall-5xl-black>: HTTP status code is not handled or not allowed
2026-01-10 17:03:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chc03004-machine-screw>: HTTP status code is not handled or not allowed
2026-01-10 17:03:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/86-h-nexel-chrome-wire-shelving-add-on-48-w-x-14-d>: HTTP status code is not handled or not allowed
2026-01-10 17:04:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cfc05035-socket-cap-screw>: HTTP status code is not handled or not allowed
2026-01-10 17:04:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/263775-ferrule-breakaway-3-16-inch-15-p>: HTTP status code is not handled or not allowed
2026-01-10 17:04:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-oxford-insulated-safety-bib-overall-xxs-black>: HTTP status code is not handled or not allowed
2026-01-10 17:04:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-fixed-length-plastic-truck-seal-7-5-green-60lbs-pull-force-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:04:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/381733-lamp-for-amana-litton>: HTTP status code is not handled or not allowed
2026-01-10 17:04:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/soft-pliable-medicine-ball-4-lb-5-diameter-red>: HTTP status code is not handled or not allowed
2026-01-10 17:04:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelite-vented-plastic-mat-shelf-truck-30l-x-21w-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 17:04:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-oxford-insulated-safety-bib-overall-m-black>: HTTP status code is not handled or not allowed
2026-01-10 17:04:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 376 pages (at 99 pages/min), scraped 160 items (at 46 items/min)
2026-01-10 17:04:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brc06-nylon-insert-lock-nut>: HTTP status code is not handled or not allowed
2026-01-10 17:04:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-11-1-8-w-x-17-7-8-d-x-4-h-red>: HTTP status code is not handled or not allowed
2026-01-10 17:04:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2031132-slide-chute-assy-for-globe-food-equipment>: HTTP status code is not handled or not allowed
2026-01-10 17:04:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cfc03010-socket-cap-screw>: HTTP status code is not handled or not allowed
2026-01-10 17:04:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cjc04005-machine-screw>: HTTP status code is not handled or not allowed
2026-01-10 17:04:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-steel-bookcase-28-h-sand>: HTTP status code is not handled or not allowed
2026-01-10 17:04:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harloff-compact-economy-treatment-cart-with-four-drawers-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:04:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-l-x-12-d-plastic-laminate-cantilever-shelf-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:04:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5000g-weight>: HTTP status code is not handled or not allowed
2026-01-10 17:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/file_folders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:04:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/360-stretch-waist-flex-twill-cargo-pants-30l-inseam-x-29-30-waist-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:04:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/511337-pilot-for-groen>: HTTP status code is not handled or not allowed
2026-01-10 17:04:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ripstop-safety-rain-jacket-csa-class-2-level-2-5xl-fluorescent-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:04:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/54-h-nexel-chrome-wire-shelving-24-w-x-14-d>: HTTP status code is not handled or not allowed
2026-01-10 17:04:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-hanging-file-folders-15-tab-11-point-stock-letter-teal-25box>: HTTP status code is not handled or not allowed
2026-01-10 17:04:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-pressboard-classification-folders-letter-six-section-yellow-10box>: HTTP status code is not handled or not allowed
2026-01-10 17:04:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-file-folders-straight-cut-one-ply-top-tab-letter-manila-100box>: HTTP status code is not handled or not allowed
2026-01-10 17:04:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-file-folders-13-cut-reinforced-top-tab-letter-purple-100box>: HTTP status code is not handled or not allowed
2026-01-10 17:04:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/relaxed-fit-flex-twill-cargo-pants-30l-inseam-x-32-waist-black>: HTTP status code is not handled or not allowed
2026-01-10 17:04:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/file_folders> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/file_folders landed on page that is not a product page.
2026-01-10 17:04:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/megaphone-6-watt-10-431>: HTTP status code is not handled or not allowed
2026-01-10 17:04:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamps-wilton14301>: HTTP status code is not handled or not allowed
2026-01-10 17:04:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hubbel-industrial-duplex-outlet-70>: HTTP status code is not handled or not allowed
2026-01-10 17:04:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/54-h-nexel-chrome-wire-shelving-add-on-48-w-x-30-d>: HTTP status code is not handled or not allowed
2026-01-10 17:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/expanding_file_folders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:04:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/passive-filter-427-replacement-lens-polycarbonate-shade-9-black-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 17:04:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-premium-5-14-accordion-expansion-wallets-poly-letter-black>: HTTP status code is not handled or not allowed
2026-01-10 17:04:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hubbel-industrial-single-outlet-16-3-25>: HTTP status code is not handled or not allowed
2026-01-10 17:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:04:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nfpa-rod-eye-3-4-16-thread-3-1-4-to-4-nfpa-cylinder>: HTTP status code is not handled or not allowed
2026-01-10 17:04:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-3-12-accordion-expansion-file-pockets-straight-tab-letter-blue-10box>: HTTP status code is not handled or not allowed
2026-01-10 17:04:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-insulated-quilted-jacket-s-olive>: HTTP status code is not handled or not allowed
2026-01-10 17:04:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-file-folders-13-cut-second-position-one-ply-top-tab-letter-manila-100box>: HTTP status code is not handled or not allowed
2026-01-10 17:04:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-amp-24v-to-12v-dc-dc-converter>: HTTP status code is not handled or not allowed
2026-01-10 17:04:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1941090-element-120v-116w>: HTTP status code is not handled or not allowed
2026-01-10 17:04:44 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/expanding_file_folders> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/expanding_file_folders landed on page that is not a product page.
2026-01-10 17:04:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hubbel-commercial-14-3-20>: HTTP status code is not handled or not allowed
2026-01-10 17:04:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamps-wilton14375>: HTTP status code is not handled or not allowed
2026-01-10 17:04:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats>: HTTP status code is not handled or not allowed
2026-01-10 17:04:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/side-guard-rails-standing-risers-4-level>: HTTP status code is not handled or not allowed
2026-01-10 17:04:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-3-12-accordion-expansion-file-tuff-pockets-straight-legal-redrope-10box>: HTTP status code is not handled or not allowed
2026-01-10 17:04:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-125mm-bore-x-150mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:04:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-tuff-hanging-folder-with-easy-slide-tab-letter-standard-green-20pack>: HTTP status code is not handled or not allowed
2026-01-10 17:04:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fireproof-4-drawer-vertical-safe-in-file-legal-31-9-16-lx20-13-16-wx52-3-4-h-parchment>: HTTP status code is not handled or not allowed
2026-01-10 17:04:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-supertab-file-folders-with-fastener-13-cut-11-point-legal-manila-50box>: HTTP status code is not handled or not allowed
2026-01-10 17:04:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frost-free-refrigerator-freezer-white-5-4-cu-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:04:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelving-add-on-72-w-x-24-d-x-63-h>: HTTP status code is not handled or not allowed
2026-01-10 17:04:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maxiflex-gloves-black-micro-foam-nitirle-coated-knit-glove-x-large-12-pairs>: HTTP status code is not handled or not allowed
2026-01-10 17:04:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1031100-screen-filter-12-inch-sq-ofst-hole-for-ultrafryer>: HTTP status code is not handled or not allowed
2026-01-10 17:05:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/430-2-8-composite-spreader-beam-2-ton-capacity-8-hook-spread>: HTTP status code is not handled or not allowed
2026-01-10 17:05:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-80mm-bore-x-40mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:05:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-r-class-2-heavy-duty-surveyor-safety-vest-zipper-2xl-green-sv59z-2zgd-2x>: HTTP status code is not handled or not allowed
2026-01-10 17:05:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-r-class-2-heavy-duty-engineer-vest-orange-2xl-sv55-2zod-2x>: HTTP status code is not handled or not allowed
2026-01-10 17:05:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16awg-2c-solid-fire-alarm-cable-fplr-1000-ft-spool-red>: HTTP status code is not handled or not allowed
2026-01-10 17:05:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fr-type-r-class-3-economy-mesh-vest-l-green-ssv97e-3vgmfr-l>: HTTP status code is not handled or not allowed
2026-01-10 17:05:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1751154-caster-plate-2-inch-rigid-for-magikitchen-products>: HTTP status code is not handled or not allowed
2026-01-10 17:05:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-r-class-3-heavy-duty-engineer-vest-orange-m-sv55-3zod-m>: HTTP status code is not handled or not allowed
2026-01-10 17:05:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 473 pages (at 97 pages/min), scraped 203 items (at 43 items/min)
2026-01-10 17:05:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/base-bar-mounting-kit-2-bore-nfpa-cylinder>: HTTP status code is not handled or not allowed
2026-01-10 17:05:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kolorcut-cutting-board-15x20x1-2-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:05:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kolorcut-cutting-board-15x20x1-2-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:05:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-level-tapered-riser-carpet-60l-x-18w-8h-16h-24h-32h-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:05:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010584-broiler-burner-for-garland-range>: HTTP status code is not handled or not allowed
2026-01-10 17:05:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inline-needle-valve-82830-04-14-tube-nickel-plated-brass>: HTTP status code is not handled or not allowed
2026-01-10 17:05:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelf-truck-72x18x80-1200-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:05:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spherical-rod-eye-cs-12-16-for-iso-cylinders-m6-threads>: HTTP status code is not handled or not allowed
2026-01-10 17:05:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelf-truck-72x24x92-1200-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:05:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-100mm-bore-x-900mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:05:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-80mm-bore-x-120mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:05:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/basic-chefs-pants-small-black>: HTTP status code is not handled or not allowed
2026-01-10 17:05:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-expandable-add-on-rack-96x48x84-gray-with-3-level-wood-deck-1100lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 17:05:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flow-control-89953-08-06-screw-adj-12-tube-x-38-swift-fit-metallic-collet>: HTTP status code is not handled or not allowed
2026-01-10 17:05:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-run-tee-89222-06-02-38-tube-x-18-swift-fit-univ-thread-metallic-collet>: HTTP status code is not handled or not allowed
2026-01-10 17:05:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kleen-plug-use-to-keep-beer-taps-clean-overnight>: HTTP status code is not handled or not allowed
2026-01-10 17:05:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flow-control-85968-53-02-knob-adj-532-tube-x-18-swift-fit-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 17:05:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-quilted-safety-freezer-jacket-m-black>: HTTP status code is not handled or not allowed
2026-01-10 17:05:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/battery-powered-lift-counter-balanced-stacker-6>: HTTP status code is not handled or not allowed
2026-01-10 17:05:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2181252-lid-dispenser-6-qt-for-star-manufacturing>: HTTP status code is not handled or not allowed
2026-01-10 17:05:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ecos-scented-liquid-laundry-detergent-magnolia-lily-2x-5-gallon-pail>: HTTP status code is not handled or not allowed
2026-01-10 17:05:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-sectional-no-cable>: HTTP status code is not handled or not allowed
2026-01-10 17:05:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insulated-cold-gear-overall-s-blackfluorescent-yellow-green>: HTTP status code is not handled or not allowed
2026-01-10 17:05:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-additional-level-wide-span-rack-60w-x-24d-no-deck-1200-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:05:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-10-1-proflex-g>: HTTP status code is not handled or not allowed
2026-01-10 17:05:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-6432-double-acting-magnetic-cylinder-25mm-bore-x-50mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:05:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-63mm-bore-x-140mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:05:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-black-urethane-reusable-cold-pack-neck-6-x-23>: HTTP status code is not handled or not allowed
2026-01-10 17:05:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6220606-screw-mach-th-ss-100>: HTTP status code is not handled or not allowed
2026-01-10 17:05:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1481008-track-v-true-33-inch-for-true-manufacturing>: HTTP status code is not handled or not allowed
2026-01-10 17:05:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cold-pack-cover-neck-9-x-25-12-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:05:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-wide-span-rack-72x48x84-gray-with-3-shelves-laminated-deck-900-lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 17:05:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-expandable-starter-rack-48x18x84-gray-with-3-level-wood-deck-1500lb-cap-per-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:05:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-10>: HTTP status code is not handled or not allowed
2026-01-10 17:05:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moto-vest-4-pockets-cottonpolyester-m-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:05:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1171304-valve-rebuild-kit-5gpf-urnl-for-zurn-industries-llc>: HTTP status code is not handled or not allowed
2026-01-10 17:05:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flow-control-85953-08-06-screw-adj-12-tube-x-38-swift-fit-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 17:05:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flow-control-85963-06-06-screw-adj-38-tube-x-38-swift-fit-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 17:05:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lockout-shadow-board-20-padlock-capacity-23w-x-316d-x-22h-red>: HTTP status code is not handled or not allowed
2026-01-10 17:05:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cold-pack-chilling-unit-chest-24l-x-26w-x-36h-5-3-cu-ft-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:05:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1711246-shaft-upper-bun-toaster-for-prince-castle>: HTTP status code is not handled or not allowed
2026-01-10 17:06:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-32mm-bore-x-2500mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:06:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-32mm-bore-x-1350mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:06:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-insulated-ice-bag-with-hook-loop-band-5-x-13>: HTTP status code is not handled or not allowed
2026-01-10 17:06:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-black-urethane-reusable-cold-pack-standard-10-x-13-1-2-12-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:06:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-extra-shelving-48x12x72-with-4-shelves-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:06:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-40mm-bore-x-85mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:06:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-6432-double-acting-magnetic-cylinder-20mm-bore-x-100mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:06:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-wide-span-rack-60x24x60-gray-with-3-shelves-laminated-deck-1200-lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 17:06:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moto-vest-4-pockets-cottonpolyester-xlt-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:06:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moto-vest-4-pockets-cottonpolyester-xlt-dark-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:06:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-6432-double-acting-magnetic-cylinder-16mm-bore-x-160mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 17:06:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moto-vest-4-pockets-cottonpolyester-3xlt-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:06:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/221373-kason-67308000008-pull-handle-for-kason>: HTTP status code is not handled or not allowed
2026-01-10 17:06:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 571 pages (at 98 pages/min), scraped 247 items (at 44 items/min)
2026-01-10 17:06:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-step-roll-fold-steel-rolling-ladder-grip-strut>: HTTP status code is not handled or not allowed
2026-01-10 17:06:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-branch-tee-60210-8-18-8mm-tube-x-18-male-bspt-thread-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:06:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foot-pedal-platform-li-truck-two-wheel-style-750-lb-capacity-2>: HTTP status code is not handled or not allowed
2026-01-10 17:06:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-12-inch-square-keystock-plain-finish-36-inch-length>: HTTP status code is not handled or not allowed
2026-01-10 17:06:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-diamond-deck-truck-48-x-30-1400-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:06:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-slim-line-cabinet-1>: HTTP status code is not handled or not allowed
2026-01-10 17:06:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-floor-curb-heavy-duty-48-in-l-3-8-in-thick-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:06:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/little-giant-wrs-series-water-removal-system-115v-integral-4-7-level>: HTTP status code is not handled or not allowed
2026-01-10 17:06:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-20-ga-36-wx24-dx85-h-open-clip-style-4-shelf>: HTTP status code is not handled or not allowed
2026-01-10 17:06:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silver-ss-bellman-cart-straight-uprights-2>: HTTP status code is not handled or not allowed
2026-01-10 17:06:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/circuit-breaker-finder>: HTTP status code is not handled or not allowed
2026-01-10 17:06:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-20-ga-48-wx18-dx85-h-open-clip-style-6-shelf>: HTTP status code is not handled or not allowed
2026-01-10 17:06:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laminated-aluminum-shim-0062-inch-thick-0002-inch-laminations-24-inch-x-24-inch-sheet>: HTTP status code is not handled or not allowed
2026-01-10 17:06:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/union-connnector-85040-06-04-38-tube-x-14-tube-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 17:06:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50024-500-plastic-barrier-chain-hdpe-2-x500-8-51mm-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:06:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0012-inch-steel-shim-stock-12-inch-x-120-inch-roll>: HTTP status code is not handled or not allowed
2026-01-10 17:06:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-184-dp-1ph-1740rpm-c184k17dk18aa>: HTTP status code is not handled or not allowed
2026-01-10 17:06:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1831130-pin-wrap-belt-10-for-roundup-food-equipment>: HTTP status code is not handled or not allowed
2026-01-10 17:06:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/51026-100-heavy-duty-plastic-barrier-chain-hdpe-2-x100-54mm-traffic-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:06:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-215-tefc-1ph-1740rpm-b-1>: HTTP status code is not handled or not allowed
2026-01-10 17:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/definite_purpose_electric_motors/agricultural_motors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:06:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-56h-tefc-1ph-3450rpm-p6k34fk17ee>: HTTP status code is not handled or not allowed
2026-01-10 17:06:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-debris-bag-b-flannelette-for-wide-area-vacuum-641830>: HTTP status code is not handled or not allowed
2026-01-10 17:06:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2381015-gasket-door-37-3-8-inch-x-77-1-2-inch-for-bally-refrigerated-boxes>: HTTP status code is not handled or not allowed
2026-01-10 17:06:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/166453-spout-cam-for-cambro>: HTTP status code is not handled or not allowed
2026-01-10 17:06:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jet-tech-4-compartment-divider-insert-30087-rack-f-14>: HTTP status code is not handled or not allowed
2026-01-10 17:06:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lineshaft-3-drive-conveyor-lsds19x16-22-3-3-f60-05-cd-19-dia-22bf-12-hp>: HTTP status code is not handled or not allowed
2026-01-10 17:06:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-male-elbow-60110-12-12-12mm-tube-x-12-bspt-thread-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:06:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/water-hog-eco-premier-fashion-mat-black-smoke-4x10>: HTTP status code is not handled or not allowed
2026-01-10 17:06:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/happy-feet-textured-mat-yellow-border-3x5>: HTTP status code is not handled or not allowed
2026-01-10 17:06:45 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/definite_purpose_electric_motors/agricultural_motors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/definite_purpose_electric_motors/agricultural_motors landed on page that is not a product page.
2026-01-10 17:06:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10mm-tube-fitting-kit-50860n-10-36-assorted-fittings-durham-slide-drawer>: HTTP status code is not handled or not allowed
2026-01-10 17:06:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clean-stride-inserts-60-layers-per-insert-24x30>: HTTP status code is not handled or not allowed
2026-01-10 17:06:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50323-10-s-hook-acetal-copolymer-2-purple-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 17:06:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-henley-shirt-xs-tall-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:06:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-henley-shirt-2xl-tall-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:06:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/51766-10-heavy-duty-master-link-acetal-copolymer-2-blue-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 17:06:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-work-shirt-4xl-tall-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:06:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/22-1097-10-1-4-inch-door-latch-with-strike-straight-handle>: HTTP status code is not handled or not allowed
2026-01-10 17:06:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m5-x-0-8-x-25mm-socket-head-cap-screw-304-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:06:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m16-x-2-0-x-35mm-socket-head-cap-screw-304-stainless-steel-pkg-of-25>: HTTP status code is not handled or not allowed
2026-01-10 17:06:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-commercial-cutlery-bin-four-compartments-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:06:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1771017-wheel-8-inch-w-delrin-bearing-for-lakeside-manufacturing>: HTTP status code is not handled or not allowed
2026-01-10 17:07:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-parts-wire-basket-with-lid-9-l-x-7-w-x-3-h-stainless-steel-price-each-for-qty-5>: HTTP status code is not handled or not allowed
2026-01-10 17:07:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pre-cut-kinesiology-tape-wrist-case-of-20>: HTTP status code is not handled or not allowed
2026-01-10 17:07:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6231032-screw-mach-fh-ss-100>: HTTP status code is not handled or not allowed
2026-01-10 17:07:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd36h-916-inch-band-heavy-duty-3-pc-part-ss-hose-clamp-10-pcs>: HTTP status code is not handled or not allowed
2026-01-10 17:07:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m20s-all-ss-worm-gear-hose-clamp-78-inch-1-34-inch-clamping-diameter-box-of-10>: HTTP status code is not handled or not allowed
2026-01-10 17:07:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/34-1221-oven-element-240v-3400w-25-3-4-inch-x-6-1-4-inch>: HTTP status code is not handled or not allowed
2026-01-10 17:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/single_phase_motors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:07:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-145-tefc-3ph-3490rpm-c145t34fk25ee>: HTTP status code is not handled or not allowed
2026-01-10 17:07:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-work-shirt-4xl-long-tall-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:07:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 664 pages (at 93 pages/min), scraped 290 items (at 43 items/min)
2026-01-10 17:07:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-electric-pallet-truck-gwk-8hbw23-lw-fits-toyota-model-8hbw24>: HTTP status code is not handled or not allowed
2026-01-10 17:07:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-dh-air153-work-shirt-xl-short-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:07:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-partition-flexible-seven-panel-9>: HTTP status code is not handled or not allowed
2026-01-10 17:07:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0005-inch-blue-plastic-color-coded-shim-stock-5-inch-x-20-inch-flat-sheet>: HTTP status code is not handled or not allowed
2026-01-10 17:07:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boardwalk-mediumweight-polypropylene-cutlery-knife-white-1000carton>: HTTP status code is not handled or not allowed
2026-01-10 17:07:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blue-plastic-box-truck-6-bushel-medium-duty>: HTTP status code is not handled or not allowed
2026-01-10 17:07:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2151205-handle-pusher-head-onion-kng-for-redco-slicers>: HTTP status code is not handled or not allowed
2026-01-10 17:07:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/single_phase_motors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/single_phase_motors landed on page that is not a product page.
2026-01-10 17:07:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-plastic-box-truck-10-bushel-medium-duty>: HTTP status code is not handled or not allowed
2026-01-10 17:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/led_bulbs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:07:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1201141-caster-stem-5-inch-5-8-11-w-brk-for-standard-keil>: HTTP status code is not handled or not allowed
2026-01-10 17:07:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-inch-x-4-inch-x-0075-inch-stainless-steel-slotted-shim-pack-of-5>: HTTP status code is not handled or not allowed
2026-01-10 17:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/file_cabinets/vertical_file_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:07:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s9495-65w-mr16-led-40-beam-spread-gu53-base-2700k-12v>: HTTP status code is not handled or not allowed
2026-01-10 17:07:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-plastic-box-truck-12-bushel>: HTTP status code is not handled or not allowed
2026-01-10 17:07:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acrylic-transparent-clip-on-sign-holder-with-spring-loaded-4-long>: HTTP status code is not handled or not allowed
2026-01-10 17:07:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-zip-front-hoodie-xl-tall-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:07:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s9284-16w-led-a21-300-beam-spread-medium-base-2700k>: HTTP status code is not handled or not allowed
2026-01-10 17:07:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/341922-heater-strip-240v500w>: HTTP status code is not handled or not allowed
2026-01-10 17:07:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-stacking-bin-clear-8>: HTTP status code is not handled or not allowed
2026-01-10 17:07:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/led_bulbs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/led_bulbs landed on page that is not a product page.
2026-01-10 17:07:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s9151-14w-led-a15-medium-base-frost-2700k>: HTTP status code is not handled or not allowed
2026-01-10 17:07:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/cabinets/file_cabinets/vertical_file_cabinets>: HTTP status code is not handled or not allowed
2026-01-10 17:07:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/381793-kason-11808000000-led-light-fixture-for-kason>: HTTP status code is not handled or not allowed
2026-01-10 17:07:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexible-childerens-mannequin-7-years-old-height-44>: HTTP status code is not handled or not allowed
2026-01-10 17:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/electric_unit_heaters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:07:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-clear-4>: HTTP status code is not handled or not allowed
2026-01-10 17:07:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-coverall-3xl-tall-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:07:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heating-cable-self-regulating-plug-in-srp126-150-120v-900w-150>: HTTP status code is not handled or not allowed
2026-01-10 17:07:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/instant-alert-monitor-fcs11-for-fc-and-fcm-series>: HTTP status code is not handled or not allowed
2026-01-10 17:07:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-premium-hulk-stacking-bin-clear-1>: HTTP status code is not handled or not allowed
2026-01-10 17:07:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cubicle-calendar-board-24W-x-14H-monthly>: HTTP status code is not handled or not allowed
2026-01-10 17:07:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-tagging-gun>: HTTP status code is not handled or not allowed
2026-01-10 17:07:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009555-door-gasket-67-7-16-inch-x-29-1-8-for-true-manufacturing>: HTTP status code is not handled or not allowed
2026-01-10 17:07:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/electric_unit_heaters>: HTTP status code is not handled or not allowed
2026-01-10 17:07:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carriage-bolt-12-13-5-12-round-head-steel-zinc-cr3-ft-grade-5-unc-pkg-of-25-492100>: HTTP status code is not handled or not allowed
2026-01-10 17:07:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-3917-10-inch-h-x-20-inch-w-x-2-inch-t-aluminum-hood-filter-ridged-baffles>: HTTP status code is not handled or not allowed
2026-01-10 17:07:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-inch-plastic-classroom-chair-set-of-five-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:07:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traveler-3-outlet-2-usb-540-joules>: HTTP status code is not handled or not allowed
2026-01-10 17:07:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/business-office-case-pkg-18-b-18l-x-13w-x-6h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:07:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pv-150w-12v-portable-inverter-auto-power-outlet>: HTTP status code is not handled or not allowed
2026-01-10 17:07:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-expansion-anchor-1-4-x-1-3-8-zamac-alloy-unc-pkg-of-50-9510>: HTTP status code is not handled or not allowed
2026-01-10 17:07:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-dock-board-with-steel-curbs-4>: HTTP status code is not handled or not allowed
2026-01-10 17:07:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wet-pick-up-tool-18-gallon-wet-dry-squeegee-vacuum>: HTTP status code is not handled or not allowed
2026-01-10 17:07:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-square-plastic-waste-receptacle-w-dome-lid-42-gallon-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:07:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-inch-x-10-inch-plexiglass-window>: HTTP status code is not handled or not allowed
2026-01-10 17:07:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1021083-drain-grate-floor-8-inch>: HTTP status code is not handled or not allowed
2026-01-10 17:08:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/06515-1-2-x-4-x-4-plastic-masonry-shim-4412-125pc>: HTTP status code is not handled or not allowed
2026-01-10 17:08:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/terracotta-outdoor-ashtray>: HTTP status code is not handled or not allowed
2026-01-10 17:08:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-defender-walk-ramp-39w-6l-4000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:08:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264086-kason-11095000013-door-closer-for-kason>: HTTP status code is not handled or not allowed
2026-01-10 17:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/furniture_parts_accessories/partition_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:08:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-36-esd-safety-edge-work-bench-adjustable-height-1-1-4-top>: HTTP status code is not handled or not allowed
2026-01-10 17:08:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexline-60-w-x-30-d-dual-sided-workstation-anti-static-top>: HTTP status code is not handled or not allowed
2026-01-10 17:08:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-light-bent-glass-fixture-holder-w-pull-chain-switch-white-finish>: HTTP status code is not handled or not allowed
2026-01-10 17:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/serveware_tableware/dinnerware/condiment_servers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:08:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phenolic-candelabra-socket-with-paper-liner-4-in-screw-terminals-double-leg>: HTTP status code is not handled or not allowed
2026-01-10 17:08:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 756 pages (at 92 pages/min), scraped 330 items (at 40 items/min)
2026-01-10 17:08:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/disposable-gloves-11-mil-latex-12-inch-and-powder-free-medical-grade-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:08:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oxford-96-rectangular-picnic-table-with-umbrella-hole-surface-mount-black>: HTTP status code is not handled or not allowed
2026-01-10 17:08:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-halogen-socket-gu10-w-mounting-holes>: HTTP status code is not handled or not allowed
2026-01-10 17:08:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8007939-hdg-knob-and-bezel-asm-for-southbend-range>: HTTP status code is not handled or not allowed
2026-01-10 17:08:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/furniture_parts_accessories/partition_accessories> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/furniture_parts_accessories/partition_accessories landed on page that is not a product page.
2026-01-10 17:08:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tilt-out-storage-bin-6-compartments-beige>: HTTP status code is not handled or not allowed
2026-01-10 17:08:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-1891-7-inch-x-2-1-2-inch-hydraulic-door-closer-1-1-8-offset>: HTTP status code is not handled or not allowed
2026-01-10 17:08:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keyless-glazed-porcelain-socket-w-cap-9-in-leads>: HTTP status code is not handled or not allowed
2026-01-10 17:08:18 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/foodservice/serveware_tableware/dinnerware/condiment_servers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/foodservice/serveware_tableware/dinnerware/condiment_servers landed on page that is not a product page.
2026-01-10 17:08:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-4-flat-washer-uss-1-3-8-i-d-136-192-thick-steel-galvanized-grade-2-pkg-of-25>: HTTP status code is not handled or not allowed
2026-01-10 17:08:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buna-n-x-profile-o-ring-dash-218-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 17:08:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buna-n-u-cup-seal-58-id-x-1-18-od-x-14-height-pack-of-5>: HTTP status code is not handled or not allowed
2026-01-10 17:08:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-stacker-single-drum-stack-for-55-gallon-drums-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:08:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/professional-transfer-ladles-and-dippers-4752-64-oz-12-3-4-long>: HTTP status code is not handled or not allowed
2026-01-10 17:08:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-plate-1-2-thick-mat-36-wide-black>: HTTP status code is not handled or not allowed
2026-01-10 17:08:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/madison-ipe-wood-outdoor-trash-can-with-ash-urn-lid-36-gallon-capacity-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:08:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/madison-4-ipe-wood-flat-bench-without-back-with-armrests-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:08:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/341328-quartz-element-104v-1800w-31-3-4-inch>: HTTP status code is not handled or not allowed
2026-01-10 17:08:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washdown-motor-56-tefc-3ph-1725-2825rpm-c6t17wc23cc>: HTTP status code is not handled or not allowed
2026-01-10 17:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/appliances/cooking_equipment/deep_fryers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:08:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-square-table-with-2-imme-armless-barstools-black-seatstudio-teak-top>: HTTP status code is not handled or not allowed
2026-01-10 17:08:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264591-grease-filter-stainless-steel-16-x-25-x-2>: HTTP status code is not handled or not allowed
2026-01-10 17:08:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-combination-internal-external-tooth-lock-washer-steel-zinc-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:08:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traex-plastic-condiment-dispenser-w-standard-lid-4740-06-black-quart-insert-size>: HTTP status code is not handled or not allowed
2026-01-10 17:08:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011306-water-pump-240v-for-ice-o-matic>: HTTP status code is not handled or not allowed
2026-01-10 17:08:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-med-hi-off-touch-switch>: HTTP status code is not handled or not allowed
2026-01-10 17:08:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-square-table-with-2-imme-armless-barstools-black-seatmaple-top>: HTTP status code is not handled or not allowed
2026-01-10 17:08:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-2-hp-sq-flange-uprated>: HTTP status code is not handled or not allowed
2026-01-10 17:08:40 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/foodservice/appliances/cooking_equipment/deep_fryers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/foodservice/appliances/cooking_equipment/deep_fryers landed on page that is not a product page.
2026-01-10 17:08:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50ml-centrifuge-tube-self-standing-resealable-bag-sterile-500-case>: HTTP status code is not handled or not allowed
2026-01-10 17:08:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tri-dex-label-holder-4>: HTTP status code is not handled or not allowed
2026-01-10 17:08:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chemical-resistant-high-temperature-teflon-ptfe-tubing-18id-x-14od-x-100-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:08:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-round-table-with-4-imme-armless-caster-chairs-black-seatmaple-top>: HTTP status code is not handled or not allowed
2026-01-10 17:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/work-benches/bench_tops_accessories/workbench_risers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:08:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-7-drawer-40-w-shallow-depth-mobile-cabinet-w-butcher-top-gray-master-keyed>: HTTP status code is not handled or not allowed
2026-01-10 17:08:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d1-handheld-laser-distance-meter-846805>: HTTP status code is not handled or not allowed
2026-01-10 17:08:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-9-drawer-standard-width-cabinet-gray-keyed-alike-4>: HTTP status code is not handled or not allowed
2026-01-10 17:08:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009639-caster-5-inch-black-wheel-inch-no-inch-brake-l-new-style>: HTTP status code is not handled or not allowed
2026-01-10 17:08:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traex-neck-only-for-bar-keep-storage-jar-3604a>: HTTP status code is not handled or not allowed
2026-01-10 17:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/appliances/food_holding_warming_equipment/steam_tables_accessories/steam_tables already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:08:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-matic-infeedexit-platform-for-adjustable-case-sealer-8000asb>: HTTP status code is not handled or not allowed
2026-01-10 17:08:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1111310-valve-hose-pre-rinse-w-swivel-for-ts-brass-bronze-works>: HTTP status code is not handled or not allowed
2026-01-10 17:08:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seat-not-available-adhesive-sign>: HTTP status code is not handled or not allowed
2026-01-10 17:08:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-electric-hydraulic-lift-table-12v-dc-48x48-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:08:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/work-benches/bench_tops_accessories/workbench_risers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/work-benches/bench_tops_accessories/workbench_risers landed on page that is not a product page.
2026-01-10 17:08:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010659-cable-kit-for-alto-shaam>: HTTP status code is not handled or not allowed
2026-01-10 17:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:08:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6t25f34k-nylon-plastic-adjustable-lever-w-steel-components-3-8-16-x-98-stud>: HTTP status code is not handled or not allowed
2026-01-10 17:08:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-plastic-storage-cabinet-36x18x37>: HTTP status code is not handled or not allowed
2026-01-10 17:08:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-super-wide-jumbo-cabinet-with-264-hook-on-bins>: HTTP status code is not handled or not allowed
2026-01-10 17:09:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/foodservice/appliances/food_holding_warming_equipment/steam_tables_accessories/steam_tables>: HTTP status code is not handled or not allowed
2026-01-10 17:09:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1961081-shield-splash-for-frymaster>: HTTP status code is not handled or not allowed
2026-01-10 17:09:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/321613-gh-2280zx-large-spindle-bore-lathe-w-acu-rite-300s-dro-collet-closer-10-hp>: HTTP status code is not handled or not allowed
2026-01-10 17:09:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/equipto-vg-bulk-rack-60-w-x-30-d-x-72-h-starter-with-corrugated-steel-decking-textured-regal-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:09:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/equipto-vg-bulk-rack-72-w-x-24-d-x-72-h-starter-with-corrugated-steel-decking-textured-putty>: HTTP status code is not handled or not allowed
2026-01-10 17:09:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cutlery-bins-99700-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:09:07 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans landed on page that is not a product page.
2026-01-10 17:09:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-s1842sz-solid-galvanized-shelf-42w-x-18d>: HTTP status code is not handled or not allowed
2026-01-10 17:09:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-square-table-with-4-imme-armless-caster-chairs-coral-seatespresso-top>: HTTP status code is not handled or not allowed
2026-01-10 17:09:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 848 pages (at 92 pages/min), scraped 367 items (at 37 items/min)
2026-01-10 17:09:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-round-table-with-4-imme-armless-caster-chairs-sky-blue-seatespresso-top>: HTTP status code is not handled or not allowed
2026-01-10 17:09:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-starter-rack-72x24x96-with-3-levels-wire-deck-1000lb-cap-per-shelf-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:09:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mtm-hydro-3200-psi-m407-gun-kit-hobby-hose-spray-wand>: HTTP status code is not handled or not allowed
2026-01-10 17:09:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/321930-gh-1640zx-large-spindle-bore-lathe-7-1-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 17:09:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-add-on-rack-48x48x84-with-3-levels-wood-deck-1500-lb-cap-per-level-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:09:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-add-on-rack-96x24x84-with-3-levels-wood-deck-800-lb-cap-per-level-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:09:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8013048-element-120v-1100w-for-sealed-well-for-advance-tabco>: HTTP status code is not handled or not allowed
2026-01-10 17:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/painting_supplies/paint_brushes_rollers_tools/paint_sprayers_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:09:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frame-extension-magliner-hand-truck>: HTTP status code is not handled or not allowed
2026-01-10 17:09:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-round-table-with-4-imme-armless-chairs-white-seatmaple-top>: HTTP status code is not handled or not allowed
2026-01-10 17:09:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leak-diverter-7-x-7-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:09:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-add-on-rack-72x24x96-with-3-levels-wood-deck-1000-lb-cap-per-level-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:09:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-heavy-duty-all-purpose-cleaner-20-pods-jar>: HTTP status code is not handled or not allowed
2026-01-10 17:09:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-base-high-back-leather-chair-black>: HTTP status code is not handled or not allowed
2026-01-10 17:09:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/690168-jtm-1-milling-machine-w-acu-rite-200s-dro-x-axis-powerfeed-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 17:09:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/additional-level-96x48-high-capacity-rack-wood-deck-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/security_access_control/safes_lockboxes/security_safes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:09:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/painting_supplies/paint_brushes_rollers_tools/paint_sprayers_accessories>: HTTP status code is not handled or not allowed
2026-01-10 17:09:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/norton-66623325028-bear-tex-non-woven-quick-change-disc-1-inch-dia-fin-grit-aluminum-oxide-type-ii>: HTTP status code is not handled or not allowed
2026-01-10 17:09:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-staple-3-4-white-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:09:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cable-tie-double-lock-6-30-lb-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:09:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/norton-66252823603-gemini-right-angle-cut-off-wheel-5-inch-x-045-inch-x-7-8-inch-36-grit-aluminum-oxide-type-1>: HTTP status code is not handled or not allowed
2026-01-10 17:09:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-durable-floor-tape-red-2-x-100-3-pack-wear-resistant-pvc>: HTTP status code is not handled or not allowed
2026-01-10 17:09:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/263896-baffle-filter-25-x-16-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:09:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10500-series153-laminate-bookcase-36w-x-13d-x-43-34h-kingswood-walnut>: HTTP status code is not handled or not allowed
2026-01-10 17:09:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditions-7-piece-patio-dining-set-w-cast-top-dining-table-6-cushioned-swivel-rockers>: HTTP status code is not handled or not allowed
2026-01-10 17:09:35 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/security_access_control/safes_lockboxes/security_safes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/security_access_control/safes_lockboxes/security_safes landed on page that is not a product page.
2026-01-10 17:09:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cut-resistant-gloves-hct-nano-foam-nitrile-coated-ansi-a2-s-green-12-pair>: HTTP status code is not handled or not allowed
2026-01-10 17:09:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/butt-splice-12-10-awg-yellow-50-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:09:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-1-2-inch-angle-grinder>: HTTP status code is not handled or not allowed
2026-01-10 17:09:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gearmotor-dc-right-angle-62rpm-cm34d25nz33b>: HTTP status code is not handled or not allowed
2026-01-10 17:09:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grid-wall-bin-stackable-8>: HTTP status code is not handled or not allowed
2026-01-10 17:09:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz-saga-frameless-safety-glasses-matte-black-in-outdoor-lens>: HTTP status code is not handled or not allowed
2026-01-10 17:09:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/norton-66253263053-gemini-bench-and-pedestal-wheel-12-inch-x-1-1-2-inch-x-1-1-2-inch-60-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 17:09:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/norton-66253410198-gemini-chop-saw-cut-off-wheel-16-inch-x-3-32-inch-x-1-inch-36-grit-aluminum-oxide-type-1>: HTTP status code is not handled or not allowed
2026-01-10 17:09:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traex-recycled-rack-dolly-base-w-2-locking-casters-1697-06-lc2-black-450-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/abrasives/sanding_discs/fiber_sanding_discs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:09:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/262785-caster>: HTTP status code is not handled or not allowed
2026-01-10 17:09:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gearmotor-dc-parallel-125rpm-cm34d25nz56b>: HTTP status code is not handled or not allowed
2026-01-10 17:09:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-strap-3-4>: HTTP status code is not handled or not allowed
2026-01-10 17:09:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-cut-resistant-gloves-nano-foam-nitrile-coated-ansi-a4-xs-black-12-pair>: HTTP status code is not handled or not allowed
2026-01-10 17:09:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n-ferno-6492-2-piece-wind-resistant-multi-band-lime>: HTTP status code is not handled or not allowed
2026-01-10 17:09:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sisal-3-strand-twisted-rope-slr-3850-38-x-50-1-lb-camel>: HTTP status code is not handled or not allowed
2026-01-10 17:09:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/half-mask-low-pressure-system-3-workers-100-hose>: HTTP status code is not handled or not allowed
2026-01-10 17:09:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rw30-3z1y-general-purpose-rain-jacket-hi-viz-lime-5xl>: HTTP status code is not handled or not allowed
2026-01-10 17:09:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/abrasives/sanding_discs/fiber_sanding_discs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/abrasives/sanding_discs/fiber_sanding_discs landed on page that is not a product page.
2026-01-10 17:09:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-buffet-station-with-wire-grill-4667580-natural-21-x-16-x-7-1-2>: HTTP status code is not handled or not allowed
2026-01-10 17:09:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-needle-scaler-4600>: HTTP status code is not handled or not allowed
2026-01-10 17:09:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scribe-engraving-chisel-kit>: HTTP status code is not handled or not allowed
2026-01-10 17:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/appliances/refrigerators_freezers/refrigerators/refrigerated_merchandisers_display_cases already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:09:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/check-holders-2518-18-long-brushed-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 17:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/task_desk_chairs/task_office_chairs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:10:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graphic-facility-signs-first-aid-vinyl-4x4>: HTTP status code is not handled or not allowed
2026-01-10 17:10:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supplied-air-shield-black-welding-helmet-deluxe-2-workers-50-hose-10-lens>: HTTP status code is not handled or not allowed
2026-01-10 17:10:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/redco-instaslice-12-blade-assembly-15207-1-4-cut>: HTTP status code is not handled or not allowed
2026-01-10 17:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_alarms_signals/forklift_alert_sensors_systems already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:10:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mx4-2424g-metromax-4-polymer-shelf-24-x-24-open-grid>: HTTP status code is not handled or not allowed
2026-01-10 17:10:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-ratchet-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/task_desk_chairs/task_office_chairs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:10:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1901351-dispenser-hot-water-120v-5gal-for-bunn-o-matic>: HTTP status code is not handled or not allowed
2026-01-10 17:10:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3653-grade-2-tubular-lock-entry-adj-2-38-to-2-34-us26d-wtn-scc-kd-asa>: HTTP status code is not handled or not allowed
2026-01-10 17:10:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knee-cpm-with-standard-hand-control>: HTTP status code is not handled or not allowed
2026-01-10 17:10:09 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/foodservice/appliances/refrigerators_freezers/refrigerators/refrigerated_merchandisers_display_cases> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/foodservice/appliances/refrigerators_freezers/refrigerators/refrigerated_merchandisers_display_cases landed on page that is not a product page.
2026-01-10 17:10:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/task_desk_chairs/task_office_chairs>: HTTP status code is not handled or not allowed
2026-01-10 17:10:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 941 pages (at 93 pages/min), scraped 403 items (at 36 items/min)
2026-01-10 17:10:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-can-type-1-one-gallon-galvanized-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:10:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/border-fill-48-3-8-x-24-3-8-pvc-glue-up-tile-in-gloss-white-pg5600>: HTTP status code is not handled or not allowed
2026-01-10 17:10:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_alarms_signals/forklift_alert_sensors_systems>: HTTP status code is not handled or not allowed
2026-01-10 17:10:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pivotal-therapy-system-soft-tissue-system-occipivot>: HTTP status code is not handled or not allowed
2026-01-10 17:10:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/task_desk_chairs/task_office_chairs>: HTTP status code is not handled or not allowed
2026-01-10 17:10:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/framing-nails-fr113-238grs-2-3-8-x-113-plastic-collated-galv-ring-shank-2000-bx>: HTTP status code is not handled or not allowed
2026-01-10 17:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/door_window_hardware/locksets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:10:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-electrodes-2-x-3-5-rectangle-40-case>: HTTP status code is not handled or not allowed
2026-01-10 17:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/walls_ceilings/ceiling_tiles already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:10:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flammable-liquid-cabinet-manual-single-door-vertical-storage-2>: HTTP status code is not handled or not allowed
2026-01-10 17:10:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-x-72-table-with-6-imme-armless-caster-chairs-coral-seatmaple-top>: HTTP status code is not handled or not allowed
2026-01-10 17:10:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ignition-20-4-way-stretch-task-chair-mid-back-17-21h-seat-cloud>: HTTP status code is not handled or not allowed
2026-01-10 17:10:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ptp208bk-tough-mark-strip>: HTTP status code is not handled or not allowed
2026-01-10 17:10:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-syle-1-48-3-8-x-24-3-8-pvc-glue-up-tile-in-oil-rubbed-bronze-pg5026>: HTTP status code is not handled or not allowed
2026-01-10 17:10:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-side-outlet-elbow-1>: HTTP status code is not handled or not allowed
2026-01-10 17:10:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011857-service-kit-waveguide-for-turbochef>: HTTP status code is not handled or not allowed
2026-01-10 17:10:27 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/fasteners/door_window_hardware/locksets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/fasteners/door_window_hardware/locksets landed on page that is not a product page.
2026-01-10 17:10:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-side-outlet-tee-2>: HTTP status code is not handled or not allowed
2026-01-10 17:10:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6x10-2-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 17:10:28 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-supplies/walls_ceilings/ceiling_tiles> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-supplies/walls_ceilings/ceiling_tiles landed on page that is not a product page.
2026-01-10 17:10:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1331408-pad-filter-powder-145x21-3-4>: HTTP status code is not handled or not allowed
2026-01-10 17:10:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-rail-flange-4>: HTTP status code is not handled or not allowed
2026-01-10 17:10:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dolly-for-1100-chair-26-chairs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:10:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eye-face-wash-wall-mounted-stainless-steel-bowl-g1750>: HTTP status code is not handled or not allowed
2026-01-10 17:10:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8014127-hood-filter-type6-galv-16x20>: HTTP status code is not handled or not allowed
2026-01-10 17:10:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locbin-3-220r-7-3-8l-x-4-1-8w-x-3h-red-24-pc>: HTTP status code is not handled or not allowed
2026-01-10 17:10:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locbin-3-240r-14-3-4l-x-8-1-4w-x-7h-red-6-pc>: HTTP status code is not handled or not allowed
2026-01-10 17:10:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-crossover-5>: HTTP status code is not handled or not allowed
2026-01-10 17:10:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-single-socket-tee-6>: HTTP status code is not handled or not allowed
2026-01-10 17:10:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10194895-harness-back-chest-d-rings-tongue-buckle-leg-straps-super-extra-large>: HTTP status code is not handled or not allowed
2026-01-10 17:10:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locboard-pegboards-lb18-b-18w-x-36h-x-9-16-blue-2-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:10:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swing-glass-door-merchandiser-73-high>: HTTP status code is not handled or not allowed
2026-01-10 17:10:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10194889-harness-back-d-ring-tongue-buckle-leg-straps-standard>: HTTP status code is not handled or not allowed
2026-01-10 17:10:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electrical-tape-1-2-x-20-assorted-colors>: HTTP status code is not handled or not allowed
2026-01-10 17:10:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-liquid-electrical-tape>: HTTP status code is not handled or not allowed
2026-01-10 17:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelving_enclosure_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:10:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009383-thermostat-ego-for-moffat>: HTTP status code is not handled or not allowed
2026-01-10 17:10:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-18-x-24-dark-yellow-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:10:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blickman-one-shelf-one-drawer-base-medical-cabinet-35-x-22-x-35-3-4>: HTTP status code is not handled or not allowed
2026-01-10 17:10:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/881081-t2-orifice-cartridgeorifice-3>: HTTP status code is not handled or not allowed
2026-01-10 17:10:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/28-divider-rotating-parts-center>: HTTP status code is not handled or not allowed
2026-01-10 17:10:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-14-x-24-blue-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/wiring_devices/contactors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:10:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/packard-fan-relay-spst-no-24-vac-mars-90290>: HTTP status code is not handled or not allowed
2026-01-10 17:10:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-eye-rigging-hook-latch-kit-5000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:10:57 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelving_enclosure_kits> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelving_enclosure_kits landed on page that is not a product page.
2026-01-10 17:10:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/packard-contactor-2-pole-30-120>: HTTP status code is not handled or not allowed
2026-01-10 17:10:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-manualstick-feed-carton-stapler>: HTTP status code is not handled or not allowed
2026-01-10 17:11:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tutco-crankcase-70-240-20-1316>: HTTP status code is not handled or not allowed
2026-01-10 17:11:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-14-x-36-white-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:11:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-plastic-utility-truck-800-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:11:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-xps-153-6-magnetic-insert-bit-holder-matte-nickel-1-4-hex>: HTTP status code is not handled or not allowed
2026-01-10 17:11:05 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/wiring_devices/contactors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/wiring_devices/contactors landed on page that is not a product page.
2026-01-10 17:11:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-standard-duty-1-2-cu-yd-tilt-truck>: HTTP status code is not handled or not allowed
2026-01-10 17:11:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/circuit-sensor-for-dual-cord-machines-with-2-wall-outlets-989cs>: HTTP status code is not handled or not allowed
2026-01-10 17:11:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-18-x-60-black-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:11:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-1292-3-piece-1-8-inch-npt-bj-flange-nipple-kit>: HTTP status code is not handled or not allowed
2026-01-10 17:11:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-x2150-2-mil-poly-tubing>: HTTP status code is not handled or not allowed
2026-01-10 17:11:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1034 pages (at 93 pages/min), scraped 442 items (at 39 items/min)
2026-01-10 17:11:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-42in-w-x-30in-d-x-72in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:11:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locking-storage-cabinet-36-w-x-18-d-x-72-h-with-removable-bins-2>: HTTP status code is not handled or not allowed
2026-01-10 17:11:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vin-tak-tackboard-with-aluminum-trim-4-feet-h-x-8-feet-w-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:11:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-48in-w-x-48in-d-x-72in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/boards_easels/enclosed_bulletin_boards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:11:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clu11-240wsh1-bk50-ufo-led-high-bay>: HTTP status code is not handled or not allowed
2026-01-10 17:11:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012309-toggle-switch-for-carter-hoffmann>: HTTP status code is not handled or not allowed
2026-01-10 17:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/boards_easels/enclosed_bulletin_boards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:11:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-60in-w-x-36in-d-x-84in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:11:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/461426-control-temperature-temp-for-ranco>: HTTP status code is not handled or not allowed
2026-01-10 17:11:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergomat-classic-3-x-4>: HTTP status code is not handled or not allowed
2026-01-10 17:11:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-heavy-duty-boltless-shelving-add-on-60in-w-x-48in-d-x-72in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:11:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-supreme-v-6-x-100-black>: HTTP status code is not handled or not allowed
2026-01-10 17:11:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spatula-8-str-flex-blk-nylon>: HTTP status code is not handled or not allowed
2026-01-10 17:11:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chefs-6-str-blk-fibrox>: HTTP status code is not handled or not allowed
2026-01-10 17:11:25 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/boards_easels/enclosed_bulletin_boards> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/boards_easels/enclosed_bulletin_boards landed on page that is not a product page.
2026-01-10 17:11:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xtreme-1-2-gallon-blender-electronic-keypad-stainless-steel-2-speeds>: HTTP status code is not handled or not allowed
2026-01-10 17:11:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/boards_easels/enclosed_bulletin_boards>: HTTP status code is not handled or not allowed
2026-01-10 17:11:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1171400-valve-wtr-stm-3-8-inch-120v-asco>: HTTP status code is not handled or not allowed
2026-01-10 17:11:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-48inw-x-48ind-x-72inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:11:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/511110-thermocouples-pk10assorted>: HTTP status code is not handled or not allowed
2026-01-10 17:11:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-12x9-rectangle-emergency-stop>: HTTP status code is not handled or not allowed
2026-01-10 17:11:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x18-2-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 17:11:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-30-x-36-white-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:11:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-triangle-24-x-24-grey-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:11:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/compact-battery-operated-work-positioner-5>: HTTP status code is not handled or not allowed
2026-01-10 17:11:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264621-hinge-kit-for-cres-cor>: HTTP status code is not handled or not allowed
2026-01-10 17:11:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-work-shirt-xl-ln-royal-blue-tcg01130223>: HTTP status code is not handled or not allowed
2026-01-10 17:11:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-coverall-l-tan-tcgscwn00116lgrg00>: HTTP status code is not handled or not allowed
2026-01-10 17:11:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slant-wire-shelving-5-shelves-36x24x74>: HTTP status code is not handled or not allowed
2026-01-10 17:11:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-30-x-41-light-grey-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:11:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-12-round-sign-fire-extinguisher-do-not-block>: HTTP status code is not handled or not allowed
2026-01-10 17:11:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-with-wood-decking-72x36x120-starter>: HTTP status code is not handled or not allowed
2026-01-10 17:11:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-open-cntr-dbl-solenoid-valve-pilot-spr-cntred-1-4-nptf-24v-dc-2w-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 17:11:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2000-respirator-storage-bag-with-zipper-14-x-16>: HTTP status code is not handled or not allowed
2026-01-10 17:11:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-20-triangular-sign-pedestrian-crossing>: HTTP status code is not handled or not allowed
2026-01-10 17:11:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/881016-liq-filter-drierdcl163s>: HTTP status code is not handled or not allowed
2026-01-10 17:11:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv11-md10-12-cal-cm2-ultrasoft-arc-flash-kit-with-fr-coverall-md-glove-size-10>: HTTP status code is not handled or not allowed
2026-01-10 17:11:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-open-cntr-dbl-solenoid-valve-pilot-spr-cntred-1-2-nptf-24v-dc-2w-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 17:11:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-with-steel-decking-60x48x72-add-on>: HTTP status code is not handled or not allowed
2026-01-10 17:11:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/water-resistant-wrist-cryogenic-glove-x-large-blue-g99crberxlwr>: HTTP status code is not handled or not allowed
2026-01-10 17:11:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2281202-support-basket-115-x-135>: HTTP status code is not handled or not allowed
2026-01-10 17:11:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-without-decking-96x36x120-starter>: HTTP status code is not handled or not allowed
2026-01-10 17:11:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/st-drawer-layout-30-compartments-5-h>: HTTP status code is not handled or not allowed
2026-01-10 17:11:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fr-hi-vis-work-shirt-type-r-class-3-2xl-fluorescent-yellow-shrtv3c32xlrg>: HTTP status code is not handled or not allowed
2026-01-10 17:11:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wgr48l-l-left-side-rack-protector-lite-48>: HTTP status code is not handled or not allowed
2026-01-10 17:11:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/68113-1-4-in-pusher-head-assembly>: HTTP status code is not handled or not allowed
2026-01-10 17:11:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-16-x-2-hex-head-cap-screw-carbon-steel-zinc-unc-grade-5-usa-100-pack-457146>: HTTP status code is not handled or not allowed
2026-01-10 17:11:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-unlined-bib-overall-34-x-32-brown-bib6dcm34x32>: HTTP status code is not handled or not allowed
2026-01-10 17:12:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2551011-blade-4-8-section-2-for-shaver-specialty-king-cutter-vegetable-potato-cutter>: HTTP status code is not handled or not allowed
2026-01-10 17:12:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosure-kit-slide-door-18-x-48-x-18-white>: HTTP status code is not handled or not allowed
2026-01-10 17:12:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2561184-brace-kit-leg-left-right-for-silver-king>: HTTP status code is not handled or not allowed
2026-01-10 17:12:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-2-spt-1-white>: HTTP status code is not handled or not allowed
2026-01-10 17:12:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-2-single-solenoid-pilot-valve-spring-return-1-4-24v-dc-2w-coil-black-connection>: HTTP status code is not handled or not allowed
2026-01-10 17:12:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010808-thermostat-for-vollrath-idea-company>: HTTP status code is not handled or not allowed
2026-01-10 17:12:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zetex-plus-mitten-14l-yellow-jumbo-m60zprh01014>: HTTP status code is not handled or not allowed
2026-01-10 17:12:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-2-double-solenoid-valve-pilot-1-4-nptf-12v-dc-3w-coil-black-connection>: HTTP status code is not handled or not allowed
2026-01-10 17:12:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1131 pages (at 97 pages/min), scraped 484 items (at 42 items/min)
2026-01-10 17:12:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/preassembled-heat-cable-fg1-12p-12-ft-120v>: HTTP status code is not handled or not allowed
2026-01-10 17:12:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-72inw-x-30ind-x-96inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:12:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/461102-thermosta-tk-5-16-x-7-1-2-42>: HTTP status code is not handled or not allowed
2026-01-10 17:12:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-0-rubber-voltage-gloves-red-size-11-dwh11011r>: HTTP status code is not handled or not allowed
2026-01-10 17:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:12:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-closed-single-solenoid-valve-ext-pilot-g-1-8-220v-ac-5va-coil-led-connection>: HTTP status code is not handled or not allowed
2026-01-10 17:12:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-x-2-x-40-160-edge-protectors-cased>: HTTP status code is not handled or not allowed
2026-01-10 17:12:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-x-2-1-2-x-36-160-edge-protectors-cased>: HTTP status code is not handled or not allowed
2026-01-10 17:12:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-32-x-1-4-phillips-flat-head-machine-screw-pkg-of-100-dwa66008>: HTTP status code is not handled or not allowed
2026-01-10 17:12:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-back-chair-black-1>: HTTP status code is not handled or not allowed
2026-01-10 17:12:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-hose-female-male-reducer-adapter-369-2520761-2-1-2-nh-x-3-4-npt-brass>: HTTP status code is not handled or not allowed
2026-01-10 17:12:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv08xl09-8-cal-cm2-arc-flash-kit-with-fr-coverall-xl-glove-size-09>: HTTP status code is not handled or not allowed
2026-01-10 17:12:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-high-three-way-kit-for-two-46-in-low-panel-with-cable>: HTTP status code is not handled or not allowed
2026-01-10 17:12:25 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers landed on page that is not a product page.
2026-01-10 17:12:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit4sc100-lg12-100-cal-cm2-arc-flash-kit-lg-glove-size-12>: HTTP status code is not handled or not allowed
2026-01-10 17:12:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv08-lg09-8-cal-cm2-arc-flash-kit-with-fr-coverall-lg-glove-size-09>: HTTP status code is not handled or not allowed
2026-01-10 17:12:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-volt-screwdriver-kit-0490-22>: HTTP status code is not handled or not allowed
2026-01-10 17:12:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit4sc40s10-40-cal-compliance-arc-flash-kit-w-short-coat-bib-overall-s-sz-10>: HTTP status code is not handled or not allowed
2026-01-10 17:12:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-dbl-solenoid-vlv-ext-pilot-closed-cntr-spr-cntred-1-8-nptf-24v-dc-2w-coil-led>: HTTP status code is not handled or not allowed
2026-01-10 17:12:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultrawedge-wedge-anchor-1-2-13-x-7-steel-zinc-pkg-of-25-157230>: HTTP status code is not handled or not allowed
2026-01-10 17:12:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-153-chrome-hamper-stand-with-foot-pedal-poly-coated-steel-lid>: HTTP status code is not handled or not allowed
2026-01-10 17:12:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-basket-279001-12-nickel-plated-steel-16l-x-13w-x-6h>: HTTP status code is not handled or not allowed
2026-01-10 17:12:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/doghouse-hotdog-cooker>: HTTP status code is not handled or not allowed
2026-01-10 17:12:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-starter-96inw-x-36ind-x-96inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:12:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-heavy-duty-boltless-shelving-add-on-36inw-x-12ind-x-72inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:12:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-wood-coat-rack-with-chrome-top-bars-1-hanging-rod-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 17:12:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/luxury-high-back-walnut-luggage-rack-w-back-strap-black-straps-1-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:12:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-rolling-laptop-stand-30w-x-16d-x-36h-graphite>: HTTP status code is not handled or not allowed
2026-01-10 17:12:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264209-door-hingetop-rh-bottom-lh-for-delfield>: HTTP status code is not handled or not allowed
2026-01-10 17:12:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-closed-g-1-2-single-solenoid-valve-pilot-spr-return-24v-dc-3w-coil-led-connection>: HTTP status code is not handled or not allowed
2026-01-10 17:12:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-58-enclosed-blower-115v-1075rpm-16hp>: HTTP status code is not handled or not allowed
2026-01-10 17:12:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-work-shirt-xl-royal-blue-tcg01130222>: HTTP status code is not handled or not allowed
2026-01-10 17:12:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-2-single-solenoid-valve-pilot-spr-return-1-4-nptf-24v-dc-3w-coil-blk-connection>: HTTP status code is not handled or not allowed
2026-01-10 17:12:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heatmaster-208-230v-825rpm-16hp-sleeve>: HTTP status code is not handled or not allowed
2026-01-10 17:12:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1180-2-drum-steel-spill-pallet-68-gallon-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:12:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-36inw-x-18ind-x-72inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:12:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-96inw-x-24ind-x-72inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:12:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-58-double-shaft-blower-230v-1075rpm-12hp>: HTTP status code is not handled or not allowed
2026-01-10 17:12:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/haws-horizontal-or-vertical-drench-shower-1012-ss-showerhead>: HTTP status code is not handled or not allowed
2026-01-10 17:12:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-work-shirt-5x-gray-tcg01150234>: HTTP status code is not handled or not allowed
2026-01-10 17:12:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/262835-bearing-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 17:12:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jrs-16w-1-3-8-dia-gal-steel-roller-for-18-roller-conveyors>: HTTP status code is not handled or not allowed
2026-01-10 17:12:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-shaft-1550rpm-115v-110-115-125hp>: HTTP status code is not handled or not allowed
2026-01-10 17:13:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelvimg-18-ga-48-wx30-dx85-h-open-clip-style-7-shelf>: HTTP status code is not handled or not allowed
2026-01-10 17:13:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-1075rpm-460v-12hp>: HTTP status code is not handled or not allowed
2026-01-10 17:13:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-96inw-x-36ind-x-96inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:13:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stanchion-kit-red-6pk-50-of-2-chain-w-c-hooks-incl-2-5-pole-14-base-40-height>: HTTP status code is not handled or not allowed
2026-01-10 17:13:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-ball-fan-208-230460v-1075rpm-1hp>: HTTP status code is not handled or not allowed
2026-01-10 17:13:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264630-hasp-lock-assembly-for-cres-cor>: HTTP status code is not handled or not allowed
2026-01-10 17:13:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-safety-view-locker-triple-tier-12x12x24-3-doors-assembled-parchment>: HTTP status code is not handled or not allowed
2026-01-10 17:13:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fr-control-2-0-long-sleeve-t-shirt-l-navy-c52fksrlslg>: HTTP status code is not handled or not allowed
2026-01-10 17:13:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1227 pages (at 96 pages/min), scraped 530 items (at 46 items/min)
2026-01-10 17:13:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-3740-charge-port-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:13:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-cal-flame-resistant-coveralls-xl-ln-navy-tcg02160870>: HTTP status code is not handled or not allowed
2026-01-10 17:13:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-locker-double-tier-12x15x36-2-door-assembled-parchment>: HTTP status code is not handled or not allowed
2026-01-10 17:13:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-58-enclosed-outdoor-ball-fan-230460v-1075rpm-34hp>: HTTP status code is not handled or not allowed
2026-01-10 17:13:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-unassembled-storage-cabinet-recessed-handle36w-x-24d-x-72h-medium-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:13:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-x-1-2-security-machine-screw-flat-torx-plus-head-steel-black-oxide-ft-100-pk-182780>: HTTP status code is not handled or not allowed
2026-01-10 17:13:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-dock-seal-40-ounce-8-w-x-10-h>: HTTP status code is not handled or not allowed
2026-01-10 17:13:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-closed-single-solenoid-valve-pilot-spr-return-1-8-nptf-220v-ac-5va-coil-blk-conn>: HTTP status code is not handled or not allowed
2026-01-10 17:13:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kitchen-pegboard-pack-storage-organization-kit-black-blue-32-x-32-x-6>: HTTP status code is not handled or not allowed
2026-01-10 17:13:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-cabinet-drawer-combination-36w-x-18d-x-66h-1-drawer2-shelf-cabinet-light-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:13:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-starter-72inw-x-48ind-x-84inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:13:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-indoor-outdoor-stackable-chair-red>: HTTP status code is not handled or not allowed
2026-01-10 17:13:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-starter-96inw-x-24ind-x-84inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:13:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/five-tier-box-locker-no-legs-1-wide-12w-x-15d-x-12h-assembled-medium-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:13:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-60inw-x-48ind-x-84inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:13:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quick-adjust-wire-shelving-48x24x86>: HTTP status code is not handled or not allowed
2026-01-10 17:13:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/soft-buna-n-foam-sheet-with-acrylic-adhesive-1-16-x-12-x-24>: HTTP status code is not handled or not allowed
2026-01-10 17:13:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-person-box-locker-no-legs-12w-x-18d-x-12h-assembled-sand>: HTTP status code is not handled or not allowed
2026-01-10 17:13:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8002693-rtd-1000-ohm-kfc-probe-for-blodgett-oven>: HTTP status code is not handled or not allowed
2026-01-10 17:13:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-foam-sheet-no-adhesive-1-4-x-12-x-12>: HTTP status code is not handled or not allowed
2026-01-10 17:13:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-hobby-craft-organizer-storage-kit-red-32-x-32-x-9>: HTTP status code is not handled or not allowed
2026-01-10 17:13:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-clip-label-holder-1-1-8-in-6-in-clear-1-in-width-shelving>: HTTP status code is not handled or not allowed
2026-01-10 17:13:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eva-foam-roll-with-acrylic-adhesive-3-8-x-36-x-9-ft>: HTTP status code is not handled or not allowed
2026-01-10 17:13:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-garden-tool-board-organizer-blue-white-48-x-32-x-9>: HTTP status code is not handled or not allowed
2026-01-10 17:13:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/label-holder-in-c-in-design-7-8-in-6-in-magnetic>: HTTP status code is not handled or not allowed
2026-01-10 17:13:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/securit-barrier-system-portable-15-dia-x-40-post-base-polished-chrome>: HTTP status code is not handled or not allowed
2026-01-10 17:13:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nv621-portable-balance-620g-x-0-1g-5-3-4-x-7-1-2-platform>: HTTP status code is not handled or not allowed
2026-01-10 17:13:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-strip-curtain-door-bulk-roll-standard-grade-clear-12-x-200-x-120>: HTTP status code is not handled or not allowed
2026-01-10 17:13:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-283-1-light-ceiling-flush-mount-w-alabaster-glass-brushed-nickel-11-5w-x-4-5h>: HTTP status code is not handled or not allowed
2026-01-10 17:13:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mixing-paddle-4-75x9-75-paddle-48x1-tubular-handle>: HTTP status code is not handled or not allowed
2026-01-10 17:13:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-open-cntr-g-1-4-dbl-solenoid-valve-pilot-spring-cntred-24v-ac-5va-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 17:13:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-wall-mounted-misting-fan-outdoor-rated-oscillating-7435-cfm-1-7-hp>: HTTP status code is not handled or not allowed
2026-01-10 17:13:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dry-erase-marker-and-eraser-kit-assorted>: HTTP status code is not handled or not allowed
2026-01-10 17:13:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aero-two-bowl-ss-sink-18-x-18>: HTTP status code is not handled or not allowed
2026-01-10 17:13:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/265835-julienne-plate-2x6-for-robot-coupe>: HTTP status code is not handled or not allowed
2026-01-10 17:13:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12ab-x-1-1-2-security-sheet-metal-screw-button-hex-socket-head-302hq-18-8-ss-usa-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:13:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/76-418-1-light-ceiling-straight-cylinder-white-9h>: HTTP status code is not handled or not allowed
2026-01-10 17:13:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-1707-bridgeview-1-light-pendant-mission-dust-bronze-16w-x-15h>: HTTP status code is not handled or not allowed
2026-01-10 17:13:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-steel-emergency-light-12v-110w>: HTTP status code is not handled or not allowed
2026-01-10 17:13:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8ab-x-3-4-security-sheet-metal-screw-flat-torx-head-302hq-stainless-steel-ft-usa-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:13:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72w-x-30d-plastic-top-ergo-line-workbench-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:13:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wide-span-rack-60x24x96-with-3-shelves-wood-deck-1200-lb-capacity-per-level>: HTTP status code is not handled or not allowed
2026-01-10 17:14:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8ab-x-2-security-sheet-metal-screw-flat-torx-head-steel-black-oxide-ft-usa-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:14:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8ab-x-3-8-security-sheet-metal-screw-button-torx-head-302hq-stainless-steel-usa-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:14:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8013325-tune-up-kit-401-601-708e-for-sani-serve>: HTTP status code is not handled or not allowed
2026-01-10 17:14:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/horizon-womens-safety-work-boots-alloy-toe-8h-size-12-carbon-black>: HTTP status code is not handled or not allowed
2026-01-10 17:14:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-inch-buna-n-cam-and-groove-gasket>: HTTP status code is not handled or not allowed
2026-01-10 17:14:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/77-140-1-light-wall-mount-w-white-glass-globe-black-6w-x-7-25h>: HTTP status code is not handled or not allowed
2026-01-10 17:14:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-edge-work-bench-top-shop-top-72-w-x-36-d-x-1-3-4-thick>: HTTP status code is not handled or not allowed
2026-01-10 17:14:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-530-1-light-die-cast-bulk-head-frosted-diffuser-semi-gloss-white-6-5w-x-10h>: HTTP status code is not handled or not allowed
2026-01-10 17:14:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1325 pages (at 98 pages/min), scraped 578 items (at 48 items/min)
2026-01-10 17:14:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-green-epoxy-wire-shelving-add-on-48w-x-12-d-x-74-h>: HTTP status code is not handled or not allowed
2026-01-10 17:14:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gravity-womens-safety-work-boots-steel-toe-4h-size-10-cognac-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:14:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magnetic-glass-whiteboard-72-x-48-black>: HTTP status code is not handled or not allowed
2026-01-10 17:14:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welding-cylinder-cart-pneumatic-wheels-33-1-4-x-23-1-16-x-57-11-16>: HTTP status code is not handled or not allowed
2026-01-10 17:14:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-4974-boxwood-1-light-outdoor-post-clear-beveled-white-8w-x-19-25h>: HTTP status code is not handled or not allowed
2026-01-10 17:14:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-steel-hose-mender>: HTTP status code is not handled or not allowed
2026-01-10 17:14:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/valence-womens-safety-work-boots-steel-toe-7h-size-12-chestnut-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:14:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-signs-caution-hard-hat-area-rigid-plastic-10-h-x-14-w>: HTTP status code is not handled or not allowed
2026-01-10 17:14:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/77-488-2-light-flood-light-w-adjust-swivel-white-15w-x-8h>: HTTP status code is not handled or not allowed
2026-01-10 17:14:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/valence-womens-safety-work-boots-steel-toe-7h-size-85-vegan-midnight-black>: HTTP status code is not handled or not allowed
2026-01-10 17:14:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2661014-brush-end-door-spout-ph61-h63-for-taylor-freezer>: HTTP status code is not handled or not allowed
2026-01-10 17:14:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelving-36x24x60-with-4-shelves-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:14:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fk22-2x2-flange-kit-for-lay-in-troffer-accessory-for-jt-series>: HTTP status code is not handled or not allowed
2026-01-10 17:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:14:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelving-36x24x84-with-5-shelves-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:14:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-meter-eva-electrically-conductive-extension-hose-50-mm-diameter-9-988-090-0>: HTTP status code is not handled or not allowed
2026-01-10 17:14:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/321181-brush-for-bar-maid-coproration>: HTTP status code is not handled or not allowed
2026-01-10 17:14:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plc-03610-32oz-natural-hdpe-wide-mouth-round-bottle-with-53-400-white-pp-cap-case-of-12>: HTTP status code is not handled or not allowed
2026-01-10 17:14:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/77-059-1-light-ceiling-flush-mount-small-mushroom-polished-brass-7-5w-x-5h>: HTTP status code is not handled or not allowed
2026-01-10 17:14:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/surface-mount-flexible-stake-24-in-h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:14:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009908-slide-rail-kit-hct-for-roundup-food-equipment>: HTTP status code is not handled or not allowed
2026-01-10 17:14:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelving-36x12x96-with-5-shelves-wire-deck-2>: HTTP status code is not handled or not allowed
2026-01-10 17:14:37 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots landed on page that is not a product page.
2026-01-10 17:14:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/free-standing-clothes-rack-3-shelf-48-w-x-24-d-x-74-h>: HTTP status code is not handled or not allowed
2026-01-10 17:14:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-48x18x84-with-5-shelves-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:14:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/441797-dual-temp-probe-assembly-for-scotsman>: HTTP status code is not handled or not allowed
2026-01-10 17:14:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5031015-filter-condenser-10-inch-x-12-inch-for-hoshizaki-of-america>: HTTP status code is not handled or not allowed
2026-01-10 17:14:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hss-tmx-metal-slitting-saw-staggered-side-chip-clear-4-inch-dia-x-9-64-inch-face-x-1-inch-hole-34-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:14:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-90mm-0748-inch-gp-hss-tmx-jobber-drill-blk-ox-118-22mm-flute-x-46mm-oal-10-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:14:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-acrylic-desk-divider-48-x-24-mounted>: HTTP status code is not handled or not allowed
2026-01-10 17:14:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/starter-unit-legal-31-inch-45-1-2-inch-48-3-4-inch-4-opening-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:14:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-boltless-shelving-starter-48inw-x-12ind-x-96inh-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:14:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-x-5-portable-wire-grid-wall-panel-semi-gloss-white>: HTTP status code is not handled or not allowed
2026-01-10 17:14:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-x-6-portable-wire-grid-wall-panel-semi-gloss-white>: HTTP status code is not handled or not allowed
2026-01-10 17:14:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-x-28-extra-long-hardboard-folding-assembly-bench>: HTTP status code is not handled or not allowed
2026-01-10 17:14:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-shank-straight-flute-tmx-chucking-reamer-decimal-size-249-6-flute>: HTTP status code is not handled or not allowed
2026-01-10 17:14:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011291-harvest-assist-kit-for-scotsman>: HTTP status code is not handled or not allowed
2026-01-10 17:14:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3d-protective-safety-corner-guards-pu-foam-adhesive-backed-black-1-each>: HTTP status code is not handled or not allowed
2026-01-10 17:14:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-boltless-shelving-add-on-48inw-x-12ind-x-96inh-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:14:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-16-w-1-step-steel-rolling-ladder-10-d-top-step-1>: HTTP status code is not handled or not allowed
2026-01-10 17:14:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-boltless-shelving-add-on-36inw-x-24ind-x-72inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:14:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ego-snt2102-20-brushless-steel-deck-self-propelled-lawnmower-kit-7-5ah-battery-550w-charger>: HTTP status code is not handled or not allowed
2026-01-10 17:15:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-rubber-load-bearing-pad-10-long-10-wide-1h>: HTTP status code is not handled or not allowed
2026-01-10 17:15:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-24-w-12-step-steel-rolling-ladder-21-d-top-step>: HTTP status code is not handled or not allowed
2026-01-10 17:15:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flashing-cone-light-amber-lens-03-10-clg>: HTTP status code is not handled or not allowed
2026-01-10 17:15:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-scrub-floor-cleaner-2-oz-packs-2308701>: HTTP status code is not handled or not allowed
2026-01-10 17:15:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-step-24-w-grip-all-directional-steel-ladder>: HTTP status code is not handled or not allowed
2026-01-10 17:15:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3200-series-safe-t-alert-back-up-alarm-107-db-12-24-volts-standard>: HTTP status code is not handled or not allowed
2026-01-10 17:15:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lodestar-electric-chain-hoist-w-chain-container-3-ton-10-ft-lift-18-11-fpm-460v>: HTTP status code is not handled or not allowed
2026-01-10 17:15:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-boltless-shelving-starter-36inw-x-24ind-x-60inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:15:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1418 pages (at 93 pages/min), scraped 622 items (at 44 items/min)
2026-01-10 17:15:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alliance-hose-spiral-wrap-hose-guard-for-1-2-to-11-16-od-25>: HTTP status code is not handled or not allowed
2026-01-10 17:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/casters_wheels/plate_casters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:15:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zinc-plated-rigid-caster-zn32-6-prb-polyurethane-with-polyethylene-center-6-dia-750-lb>: HTTP status code is not handled or not allowed
2026-01-10 17:15:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sbx-connector-2-0-wire-gauge-350-amp-gray-inan-267>: HTTP status code is not handled or not allowed
2026-01-10 17:15:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-rigid-caster-ss-13-5-tpr-thermoplastic-rubber-5-dia-300-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:15:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sb-smh-connector-2-wire-gauge-175-amp-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/fire_protection/fire_extinguishers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:15:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011493-valve-housing-drain-for-hoshizaki-of-america>: HTTP status code is not handled or not allowed
2026-01-10 17:15:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-24-w-8-step-steel-rolling-ladder-10-d-top-step-kdsr108246>: HTTP status code is not handled or not allowed
2026-01-10 17:15:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-24-w-2-step-steel-rolling-ladder-10-d-top-step-kdsr102246>: HTTP status code is not handled or not allowed
2026-01-10 17:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/exit_sign_replacement_parts_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:15:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/38-style-b-j-hook>: HTTP status code is not handled or not allowed
2026-01-10 17:15:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-emergency-unit-sq-heads-remote-capacity-self-diagnostics-nicad-battery120-277v>: HTTP status code is not handled or not allowed
2026-01-10 17:15:21 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/material-handling/casters_wheels/plate_casters> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/material-handling/casters_wheels/plate_casters landed on page that is not a product page.
2026-01-10 17:15:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-emergency-unit-with-square-heads-and-self-diagnostics-nicad-battery-120-277v>: HTTP status code is not handled or not allowed
2026-01-10 17:15:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-boltless-shelving-add-on-48inw-x-24ind-x-72inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:15:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-20-spread-beam-telescoping-adjustable-10-000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:15:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/fire_protection/fire_extinguishers>: HTTP status code is not handled or not allowed
2026-01-10 17:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/dollies/lever_dollies already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:15:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cyclone-hand-chain-hoist-on-low-headroom-plain-trolley-3-ton-15-ft-lift>: HTTP status code is not handled or not allowed
2026-01-10 17:15:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/266234-socket-leg-steel-weld-mount>: HTTP status code is not handled or not allowed
2026-01-10 17:15:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ebf-85-4-bdt>: HTTP status code is not handled or not allowed
2026-01-10 17:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:15:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ebf-85-8-bdt>: HTTP status code is not handled or not allowed
2026-01-10 17:15:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-3-shelf-boltless-shelving-starter-36inw-x-24ind-x-60inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:15:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-upholstered-shop-stool-steel-frame-1>: HTTP status code is not handled or not allowed
2026-01-10 17:15:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-rectangular-outdoor-table-expanded-metal-green>: HTTP status code is not handled or not allowed
2026-01-10 17:15:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/light-to-medium-duty-service-door-single-panel-gray-3ft-x-7ft>: HTTP status code is not handled or not allowed
2026-01-10 17:15:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/dollies/lever_dollies>: HTTP status code is not handled or not allowed
2026-01-10 17:15:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-uncaged-fixed-access-ladder-yellow-8>: HTTP status code is not handled or not allowed
2026-01-10 17:15:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-safety-view-locker-six-tier-12x18x12-6-doors-unassembled-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:15:39 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs landed on page that is not a product page.
2026-01-10 17:15:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/75t3q-cl-75w-halogen-w-double-ended-base-130v>: HTTP status code is not handled or not allowed
2026-01-10 17:15:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36176-cutoff-wheels-3-inch-x-1-32-inch-x-3-8-inch-for-die-grinder-mandrel-60-grit-zirconia>: HTTP status code is not handled or not allowed
2026-01-10 17:15:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-74-inch-high-post-black-epoxy-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:15:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pressure-relief-valve-3-4-npt-for-champion-104649>: HTTP status code is not handled or not allowed
2026-01-10 17:15:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-80-inch-high-post-nexelon-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:15:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-sign-4-sided-legend-caution-wet-floor>: HTTP status code is not handled or not allowed
2026-01-10 17:15:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lcd4091blk-32-63-full-motion-monitor-wall-mount-black>: HTTP status code is not handled or not allowed
2026-01-10 17:15:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/underhoist-component-stand-w-foot-pedal-1-650-capacity-lbs>: HTTP status code is not handled or not allowed
2026-01-10 17:15:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cardboard-corrugated-boxes-22l-x-22w-x-24h-kraft-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 17:15:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zipl4d1-4-channel-plug-play-nvr-and-ip-kit-4-dome-cameras-1tb>: HTTP status code is not handled or not allowed
2026-01-10 17:15:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-w-diamond-sof-tred-mat-black-yellow-2>: HTTP status code is not handled or not allowed
2026-01-10 17:15:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/federal-signal-two-way-intercom-standard>: HTTP status code is not handled or not allowed
2026-01-10 17:15:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-w-heritage-rib-mat-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:15:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/893-filament-tape-1-2-x-60-yds-6-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 17:15:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8915-clean-removal-filament-tape-1-x-60-yds-6-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 17:15:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/homak-rd02027401-rs-pro-series-27w-x-23d-x-21h-4-drawer-red-top-chest-with-lift-latch>: HTTP status code is not handled or not allowed
2026-01-10 17:15:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergo-iws-24-d-pedestrian-detection-24in-led-sign-combo>: HTTP status code is not handled or not allowed
2026-01-10 17:15:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/light-duty-floor-crane-500-lb-capacity-9>: HTTP status code is not handled or not allowed
2026-01-10 17:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/compact_fluorescent_light_bulbs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:16:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-wide-rib-corrugated-rubber-floor-mat-1-8-thick-x-4-x-10-utility-runner>: HTTP status code is not handled or not allowed
2026-01-10 17:16:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ph-hepa-filter-for-ph-390asb>: HTTP status code is not handled or not allowed
2026-01-10 17:16:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009299-cartridge-hinge-sprin-right-for-hoshizaki-of-america>: HTTP status code is not handled or not allowed
2026-01-10 17:16:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8015526-probe-kit-for-true-manufacturing>: HTTP status code is not handled or not allowed
2026-01-10 17:16:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-w-x-30-d-mobile-production-workbench-with-power-apron-esd-square-edge-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:16:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23t2-27-23w-compact-fluorescent-w-medium-base-warm-white>: HTTP status code is not handled or not allowed
2026-01-10 17:16:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-height-wobble-stool-swivel-chair-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:16:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1510 pages (at 92 pages/min), scraped 662 items (at 40 items/min)
2026-01-10 17:16:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-wall-gaylord-bottom-48l-x-40w-x-48h-kraft-pack-of-5>: HTTP status code is not handled or not allowed
2026-01-10 17:16:11 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/compact_fluorescent_light_bulbs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/compact_fluorescent_light_bulbs landed on page that is not a product page.
2026-01-10 17:16:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cft8w-4p-835-18w-compact-fluorescent-w-gx24vq-2-base-neutral-white>: HTTP status code is not handled or not allowed
2026-01-10 17:16:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012440-bushing-cylinder-for-electro-freeze>: HTTP status code is not handled or not allowed
2026-01-10 17:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/halogen_bulbs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:16:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pic-gauges-2-1-2-pressure-gauge-liquid-filled-200-psi-ss-case-center-back-mount-pro-202l-254g>: HTTP status code is not handled or not allowed
2026-01-10 17:16:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rack-pdu-basic-ap7554>: HTTP status code is not handled or not allowed
2026-01-10 17:16:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bl-ph-replacement-ph-filter-for-bottless-coolers>: HTTP status code is not handled or not allowed
2026-01-10 17:16:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-1443-defrost-control-timer-208-240v>: HTTP status code is not handled or not allowed
2026-01-10 17:16:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5t2c-50-5w-compact-fluorescent-w-candelabra-base-natural-light>: HTTP status code is not handled or not allowed
2026-01-10 17:16:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dspbl-powder-free-glove-sm-ltx-white-100bx>: HTTP status code is not handled or not allowed
2026-01-10 17:16:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-8-3-8-w-x-17-7-8-d-x-4-h-yellow-2>: HTTP status code is not handled or not allowed
2026-01-10 17:16:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-cardboard-corrugated-boxes-15l-x-11w-x-4h-kraft-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 17:16:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/purell-sanitizing-hand-wipes>: HTTP status code is not handled or not allowed
2026-01-10 17:16:24 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/halogen_bulbs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/halogen_bulbs landed on page that is not a product page.
2026-01-10 17:16:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500q-cl-500w-halogen-w-mini-can-base>: HTTP status code is not handled or not allowed
2026-01-10 17:16:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/separable-roller-follower-metric-nast30zzr-crowned-od-double-shielded-30-mm-bore-62-mm-od>: HTTP status code is not handled or not allowed
2026-01-10 17:16:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lubrication-adapter-kit-7pc>: HTTP status code is not handled or not allowed
2026-01-10 17:16:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-ton-ironworker-3-phase-230v-w-hydraulic-accessory-pack-iw50-3p230-ac500>: HTTP status code is not handled or not allowed
2026-01-10 17:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery/metal_cutting_forming_machines/combination_metalworking_machines already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:16:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-9>: HTTP status code is not handled or not allowed
2026-01-10 17:16:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a606ch-continuous-hinge-wclamps-type-12-600x600x400-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 17:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery/metal_cutting_forming_machines/combination_metalworking_machines already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:16:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-13>: HTTP status code is not handled or not allowed
2026-01-10 17:16:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glass-bead-size-140-270-521200b-50>: HTTP status code is not handled or not allowed
2026-01-10 17:16:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tire-inflation-safety-cage-2-bar-heavy-duty-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:16:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dspbl-dust-head-36x5-cttnsyn-12>: HTTP status code is not handled or not allowed
2026-01-10 17:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/laundry_detergent already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:16:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/282400-breaker-strip-for-perlick-refrigeration>: HTTP status code is not handled or not allowed
2026-01-10 17:16:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-max-premium-xr-power-tool-battery-pack-6-0ah-lithium-ion-60-min-charge>: HTTP status code is not handled or not allowed
2026-01-10 17:16:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-max-xr-fencing-stapler-kit-9-gauge-for-use-w-1-2-w-fencing-staples-35-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:16:39 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/machining/machinery/metal_cutting_forming_machines/combination_metalworking_machines> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/machining/machinery/metal_cutting_forming_machines/combination_metalworking_machines landed on page that is not a product page.
2026-01-10 17:16:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/38-1275-angle-plug-nema-15-50p-3-phase>: HTTP status code is not handled or not allowed
2026-01-10 17:16:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/machining/machinery/metal_cutting_forming_machines/combination_metalworking_machines>: HTTP status code is not handled or not allowed
2026-01-10 17:16:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-174-48-w-le-handed-return-table-rustic-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:16:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-accessory-long-divider-18>: HTTP status code is not handled or not allowed
2026-01-10 17:16:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40g40-40w-incandescent-w-medium-base>: HTTP status code is not handled or not allowed
2026-01-10 17:16:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/laundry_detergent>: HTTP status code is not handled or not allowed
2026-01-10 17:16:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-accessory-long-divider-12>: HTTP status code is not handled or not allowed
2026-01-10 17:16:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-without-lid-12>: HTTP status code is not handled or not allowed
2026-01-10 17:16:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/x18t5-18w-miniature-sealed-beams-w-mini-wedge-base>: HTTP status code is not handled or not allowed
2026-01-10 17:16:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-w-x-72-l-forkli-fork-tine-extension-pair>: HTTP status code is not handled or not allowed
2026-01-10 17:16:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/face-fly-applicator-kit>: HTTP status code is not handled or not allowed
2026-01-10 17:16:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-leg-workbench-with-fixed-height-legs-26>: HTTP status code is not handled or not allowed
2026-01-10 17:16:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/full-face-visor-black>: HTTP status code is not handled or not allowed
2026-01-10 17:16:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-cantilever-rack-single-sided-add-on-heavy-duty-72-w-x-50-d-x-10-h-with-lip>: HTTP status code is not handled or not allowed
2026-01-10 17:16:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardian-booth-8-x-10-guard-booth-economy-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:16:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uhmw-polyethylene-plastic-sheet-1-4-thick-x-24-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 17:16:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-strip-door-curtain-6-w-x-13-h>: HTTP status code is not handled or not allowed
2026-01-10 17:16:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/micro-therm-mini-heat-gun-with-heat-deflector>: HTTP status code is not handled or not allowed
2026-01-10 17:16:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/25g25-w-25w-incandescent-w-medium-base-120v>: HTTP status code is not handled or not allowed
2026-01-10 17:17:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uhmw-polyethylene-plastic-sheet-1-4-thick-x-48-wide-x-96-long>: HTTP status code is not handled or not allowed
2026-01-10 17:17:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-step-stairway-slope-work-platform-w-handrails-24in-x-72in-platform>: HTTP status code is not handled or not allowed
2026-01-10 17:17:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scratch-resistant-strip-door-curtain-6-w-x-10-h>: HTTP status code is not handled or not allowed
2026-01-10 17:17:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scratch-resistant-strip-door-curtain-10-w-x-10-h>: HTTP status code is not handled or not allowed
2026-01-10 17:17:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/150-gallon-x-large-tote-combo-spill-kit-universal-1380-ye>: HTTP status code is not handled or not allowed
2026-01-10 17:17:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/25a19-f-25w-incandescent-w-medium-base-130v>: HTTP status code is not handled or not allowed
2026-01-10 17:17:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hipower-ii-classical-section-wrapped-vbelt-gates-a46>: HTTP status code is not handled or not allowed
2026-01-10 17:17:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/511525-thermocouple-standard-72-inch-for-white-rodgers>: HTTP status code is not handled or not allowed
2026-01-10 17:17:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-drum-hardcover-spillpallet-with-drain-66-gallon-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:17:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-step-stairway-slope-work-platform-24in-x-60in-platform>: HTTP status code is not handled or not allowed
2026-01-10 17:17:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1605 pages (at 95 pages/min), scraped 699 items (at 37 items/min)
2026-01-10 17:17:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-silent-pneumatic-turbine-vibrator-vs-510>: HTTP status code is not handled or not allowed
2026-01-10 17:17:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedy-duffel-spill-kit-oil-only-10-gal-capacity-yellow-1312-ye>: HTTP status code is not handled or not allowed
2026-01-10 17:17:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-silent-pneumatic-turbine-vibrator-mltss-19-ht>: HTTP status code is not handled or not allowed
2026-01-10 17:17:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-purpose-drum-stacker-4-drum-system-no-drain>: HTTP status code is not handled or not allowed
2026-01-10 17:17:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stinger-rail-berm-48-x-72-x-12-black-48-rsb-fs>: HTTP status code is not handled or not allowed
2026-01-10 17:17:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e85-1-12w-miniature-w-sub-mini-wedge-base>: HTTP status code is not handled or not allowed
2026-01-10 17:17:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/511170-coil-solenoid-220-240v>: HTTP status code is not handled or not allowed
2026-01-10 17:17:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t5-fluorescent-bulb-g5-base-54w-5000-lumens-4100k-cool-white-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 17:17:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-1-thick-x-1-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:17:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/13491-water-filter-cartridgehf40-for-cuno-inc>: HTTP status code is not handled or not allowed
2026-01-10 17:17:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cantilever-rack-inclined-arm-11>: HTTP status code is not handled or not allowed
2026-01-10 17:17:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lodestar-vs-electric-chain-hoist-1-2-ton-10-foot-lift-2-6-16-fpm-230-1-60-3-step-iv-control>: HTTP status code is not handled or not allowed
2026-01-10 17:17:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plt-u-bend-fluorescent-bulb-gx24q3-base-32w-2400-lumens-6500k-daylight-pk-of-10>: HTTP status code is not handled or not allowed
2026-01-10 17:17:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-silent-pneumatic-turbine-vibrator-bbs-190>: HTTP status code is not handled or not allowed
2026-01-10 17:17:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-in-dustbuddie-kit-1>: HTTP status code is not handled or not allowed
2026-01-10 17:17:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omni-pir-ceiling-low-voltage-sensor-with-450-sq-ft-range-off-white>: HTTP status code is not handled or not allowed
2026-01-10 17:17:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-adjustable-led-emergency-light-fixture-4w-200-lumens-120-277v>: HTTP status code is not handled or not allowed
2026-01-10 17:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:17:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010707-potentiometer-for-hatco-corp>: HTTP status code is not handled or not allowed
2026-01-10 17:17:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012265-field-kit-probe-moldedstmchef-1-pc-con-for-cleveland-range>: HTTP status code is not handled or not allowed
2026-01-10 17:17:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2201385-pilot-assembly-2-burner-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 17:17:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-plastic-rod-3-diameter-x-1-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:17:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ushio-hpl-575-115v-js115v-575wc>: HTTP status code is not handled or not allowed
2026-01-10 17:17:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010101-solenoid-repair-kit-no-disc-assembly-core>: HTTP status code is not handled or not allowed
2026-01-10 17:17:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/milton-s-1837w-h-style-industrial-plug-3-8-mnpt>: HTTP status code is not handled or not allowed
2026-01-10 17:17:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/milton-789-t-style-automotive-coupler-3-8-mnpt-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:17:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ushio-g36t5vh-germicidallamp>: HTTP status code is not handled or not allowed
2026-01-10 17:17:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/840-style-woven-wire-hinge-door-4w-x-7h-10-5-1-4-overall-height>: HTTP status code is not handled or not allowed
2026-01-10 17:17:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rapidwire-welded-wire-4-sided-cage-w-3-hinged-door-ceiling-12-6-x-12-6-x-12-5-1-4h>: HTTP status code is not handled or not allowed
2026-01-10 17:17:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-par20-spotlight-bulb-e26-base-8w-500-lumens-4000k-cool-white-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 17:17:40 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock landed on page that is not a product page.
2026-01-10 17:17:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/521076-gas-valve1-8-mpt-x-3-8-27-for-garland-range>: HTTP status code is not handled or not allowed
2026-01-10 17:17:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/76-1158-inline-carbon-block-water-filter-cartridge-il-35-1-micron-rated-3000-gallon>: HTTP status code is not handled or not allowed
2026-01-10 17:17:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chillits-6710ct-evaporative-cooling-triangle-hat-with-cooling-towel-solid-blue-12587>: HTTP status code is not handled or not allowed
2026-01-10 17:17:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-g1sc-118-b>: HTTP status code is not handled or not allowed
2026-01-10 17:17:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-g2sc-118-ss>: HTTP status code is not handled or not allowed
2026-01-10 17:17:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wireway-pallet-rack-tear-drop-upright-frame-240x42>: HTTP status code is not handled or not allowed
2026-01-10 17:17:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-individual-transfer-punch-7-16>: HTTP status code is not handled or not allowed
2026-01-10 17:17:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-skfl31-chemical-sorbent-spill-kit-31-gallon-1-case>: HTTP status code is not handled or not allowed
2026-01-10 17:17:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-gsc-200-z>: HTTP status code is not handled or not allowed
2026-01-10 17:17:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/088trblksml-base-layer-top-black-small>: HTTP status code is not handled or not allowed
2026-01-10 17:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:17:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-g1sc-125-ss>: HTTP status code is not handled or not allowed
2026-01-10 17:17:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/upright-angled-broom-blue-flagged-polypropylene-with-steel-handle>: HTTP status code is not handled or not allowed
2026-01-10 17:17:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72x36-esd-square-edge-power-apron-production-bench-tan-32313715>: HTTP status code is not handled or not allowed
2026-01-10 17:17:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-gsc-150-ss>: HTTP status code is not handled or not allowed
2026-01-10 17:17:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-w-x-30-d-mobile-production-workbench-with-power-apron-maple-butcher-block-square-edge-blue-32313736>: HTTP status code is not handled or not allowed
2026-01-10 17:17:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009665-ballast-menu-universal-asb041212bltp>: HTTP status code is not handled or not allowed
2026-01-10 17:18:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fiberglass-handle-with-compression-lock-60-l-x-1-d>: HTTP status code is not handled or not allowed
2026-01-10 17:18:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/removable-model-a-corner-bumper-guard-white>: HTTP status code is not handled or not allowed
2026-01-10 17:18:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents>: HTTP status code is not handled or not allowed
2026-01-10 17:18:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-g2sc-218-ss>: HTTP status code is not handled or not allowed
2026-01-10 17:18:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combination-metal-storage-cabinet-36x18x72-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:18:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-pld-light-bulb-g24q-4-pin-base-9w-950-lumens-3500k-neutral-white-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 17:18:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20-x-1-2-wing-screw-1-1-4-head-width-malleable-iron-plain-usa-pkg-of-25>: HTTP status code is not handled or not allowed
2026-01-10 17:18:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-gsc-206-ss>: HTTP status code is not handled or not allowed
2026-01-10 17:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:18:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ulti-mate-garage-2-0-series-8-piece-cabinet-set-141w-x-21d-x-36-5h-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:18:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1700 pages (at 95 pages/min), scraped 740 items (at 41 items/min)
2026-01-10 17:18:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ulti-mate-garage-2-0-series-9-piece-cabinet-set-142w-x-21-14d-wall-x-80h-silver>: HTTP status code is not handled or not allowed
2026-01-10 17:18:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ulti-mate-garage-2-0-series-9-piece-cabinet-set-142w-x-21-14d-wall-x-80h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:18:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1171183-cartridge-cgt-10-carbon-10-inch-for-everpure-filter>: HTTP status code is not handled or not allowed
2026-01-10 17:18:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/made-in-usa-a-2-air-hardening-flat-stock-1-2x1-16x36>: HTTP status code is not handled or not allowed
2026-01-10 17:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:18:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23-75-in-round-tempered-glass-metal-table>: HTTP status code is not handled or not allowed
2026-01-10 17:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/outdoor_furniture/umbrellas_awnings_shades/outdoor_umbrellas_bases/umbrellas already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:18:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bearkat-bk112af-safety-glasses-bk1-gray-lens-gray-frame-anti-fog>: HTTP status code is not handled or not allowed
2026-01-10 17:18:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-gsc-050-z>: HTTP status code is not handled or not allowed
2026-01-10 17:18:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets>: HTTP status code is not handled or not allowed
2026-01-10 17:18:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009733-hubbell-ss-gang-platesingle>: HTTP status code is not handled or not allowed
2026-01-10 17:18:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-367218-ts-bookcase-all-welded-36-wx18-dx72-h-tropic-sand>: HTTP status code is not handled or not allowed
2026-01-10 17:18:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solid-galvanized-shelf-72x18>: HTTP status code is not handled or not allowed
2026-01-10 17:18:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-step-steel-safety-rolling-ladder-w-weight-actuated-lock-step-24-w-perforated-step-w-cal-osha-handrail-cal-wa144014p>: HTTP status code is not handled or not allowed
2026-01-10 17:18:23 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets landed on page that is not a product page.
2026-01-10 17:18:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cargo-load-binder-straight-style-e-type-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:18:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-mission-style-lantern-outdoor-vanity-light-fixture-9w-600-lumens-6-18l-black>: HTTP status code is not handled or not allowed
2026-01-10 17:18:25 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/outdoor_furniture/umbrellas_awnings_shades/outdoor_umbrellas_bases/umbrellas> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/outdoor_furniture/umbrellas_awnings_shades/outdoor_umbrellas_bases/umbrellas landed on page that is not a product page.
2026-01-10 17:18:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-gsc-050-b>: HTTP status code is not handled or not allowed
2026-01-10 17:18:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-20in-x-20in-low-table-aluminum-volcanic-black-sunset>: HTTP status code is not handled or not allowed
2026-01-10 17:18:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-channel-cable-guard-end-caps>: HTTP status code is not handled or not allowed
2026-01-10 17:18:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010582-burner-valve-for-garland-range>: HTTP status code is not handled or not allowed
2026-01-10 17:18:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-coupling-grc-112-kw>: HTTP status code is not handled or not allowed
2026-01-10 17:18:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a335-manual-sealless-combination-tool-1-2-w-regular-duty-steel-strapping>: HTTP status code is not handled or not allowed
2026-01-10 17:18:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-fiberglass-step-ladder-w-plastic-tool-tray-1>: HTTP status code is not handled or not allowed
2026-01-10 17:18:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-fiberglass-platform-step-ladder-2>: HTTP status code is not handled or not allowed
2026-01-10 17:18:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comfort-park-avenue-bench-recycled-plastic-6-ft-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:18:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-364213-h-grn-bookcase-all-welded-36-wx13-dx42-h-hunter-green>: HTTP status code is not handled or not allowed
2026-01-10 17:18:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pc-l-i-hss-silver-deming-style-reamer-set-5-8-1>: HTTP status code is not handled or not allowed
2026-01-10 17:18:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-step-steel-safety-stairway-slope-rolling-ladder-weight-actuated-lock-16-w-expan-step-w-cal-osha-handrail-cal-wa-sw-82414x>: HTTP status code is not handled or not allowed
2026-01-10 17:18:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-pull-valve-5-port-2-pos-1-4-npt>: HTTP status code is not handled or not allowed
2026-01-10 17:18:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-16-w-7-step-steel-rolling-ladder-14-d-top-step-w-handrails-orange-w-cal-osha-handrail-cal-fsh718p-o>: HTTP status code is not handled or not allowed
2026-01-10 17:18:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gtek-nitrile-coated-nylon-grip-gloves-x-large>: HTTP status code is not handled or not allowed
2026-01-10 17:18:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modern-cylinder-vanity-light-fixture-60w-22l-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 17:18:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-16-w-6-step-steel-rolling-ladder-14-d-top-step-w-handrails-orange-w-cal-osha-handrail-cal-fsh618p-o>: HTTP status code is not handled or not allowed
2026-01-10 17:18:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/venture-patio-umbrella-with-silver-pole-132w-olefin-kiwi-fabric>: HTTP status code is not handled or not allowed
2026-01-10 17:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:18:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-365218-h-grn-bookcase-all-welded-36-wx18-dx52-h-hunter-green>: HTTP status code is not handled or not allowed
2026-01-10 17:18:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/25-w-x-14-h-x-1-d-pleated-merv-8-high-capacity-air-filter-global-industrial>: HTTP status code is not handled or not allowed
2026-01-10 17:18:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zip-a-duct-20in-gray-straight-section-without-vents-5ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:18:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-w-x-18-h-x-1-d-pleated-merv-8-standard-capacity-air-filter-global-industrial>: HTTP status code is not handled or not allowed
2026-01-10 17:18:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-w-x-24-h-x-4-d-mini-pleated-merv-15-air-filter-single-header-global-industrial>: HTTP status code is not handled or not allowed
2026-01-10 17:18:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graphic-signs-caution-hearing-protection-vinyl-10-w-x-14-h>: HTTP status code is not handled or not allowed
2026-01-10 17:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/retail_fixtures_displays_equipment/displays_display_racks/gondola_shelving already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:18:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lyon-gussets-6x6-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 17:18:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/connecting-clampmounting-bracket-ra118105m-for-md4-frl-components>: HTTP status code is not handled or not allowed
2026-01-10 17:18:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-copper-fitting-with-90-long-radius-street-elbow-ftg-x-c-38-od-x-14-id-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:18:57 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps landed on page that is not a product page.
2026-01-10 17:18:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-step-16-wx71-d-stainless-steel-rolling-safety-ladder-serrated-grating-w-cal-osha-handrail-cal-ss082421g>: HTTP status code is not handled or not allowed
2026-01-10 17:18:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bronze-hose-braid-w-copper-sweat-ends-2x10-5>: HTTP status code is not handled or not allowed
2026-01-10 17:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/computers_electronics/audio_video_equipment/audio_visual_mounts/monitor_mounts_stands already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:19:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/25-w-x-20-h-x-4-d-pleated-merv-10-high-capacity-air-filter-global-industrial>: HTTP status code is not handled or not allowed
2026-01-10 17:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/stands/printer_stands already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:19:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-copper-fitting-with-rolled-stop-coupling-c-x-c-1-18-od-x-1-id-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:19:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/imported-type-c-tool-holder-bushing-2od-x-1-12id>: HTTP status code is not handled or not allowed
2026-01-10 17:19:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/foodservice/retail_fixtures_displays_equipment/displays_display_racks/gondola_shelving>: HTTP status code is not handled or not allowed
2026-01-10 17:19:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aah-30rb-db-storage-cabinet-all-welded-30-wx18-dx72-h-denim-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:19:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aah-48rbmag2-r-storage-cabinet-all-welded-48-wx18-dx78-h-red>: HTTP status code is not handled or not allowed
2026-01-10 17:19:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/backstroke-flags-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:19:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-heavy-duty-wheel-chock-polyurethane-17l-x-14w-x-14h>: HTTP status code is not handled or not allowed
2026-01-10 17:19:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/computers_electronics/audio_video_equipment/audio_visual_mounts/monitor_mounts_stands>: HTTP status code is not handled or not allowed
2026-01-10 17:19:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1793 pages (at 93 pages/min), scraped 778 items (at 38 items/min)
2026-01-10 17:19:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/stands/printer_stands>: HTTP status code is not handled or not allowed
2026-01-10 17:19:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infinity-locker-single-tier-12x12x60-1-door-assembled-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:19:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-inward-swing-partition-door-w-hardware-26w-azure>: HTTP status code is not handled or not allowed
2026-01-10 17:19:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maah-36782rb-wr-mobile-cabinet-all-welded-36-wx24-dx78-h-wine-red>: HTTP status code is not handled or not allowed
2026-01-10 17:19:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-7w-x-82h-sand-beach>: HTTP status code is not handled or not allowed
2026-01-10 17:19:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5900552-cable-chocker-fixed-310-cap-lbs>: HTTP status code is not handled or not allowed
2026-01-10 17:19:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5901583-flexible-counterweight-for-rope-lifeline>: HTTP status code is not handled or not allowed
2026-01-10 17:19:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impres-2900-mah-li-ion-battery-for-xpr-series-portable-radios>: HTTP status code is not handled or not allowed
2026-01-10 17:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/welding/filler_metals/brazing_soldering_filler_metal already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:19:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr240-submersible-vhf-marine-handheld-portable-radio>: HTTP status code is not handled or not allowed
2026-01-10 17:19:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-outward-swing-partition-door-w-hardware-36w-pepper-dust>: HTTP status code is not handled or not allowed
2026-01-10 17:19:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8510826-heavy-duty-zinc-plated-sleeve-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:19:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mayo-instrument-stand-with-mobile-5-inch-caster-base>: HTTP status code is not handled or not allowed
2026-01-10 17:19:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forney-e71t-gs-self-steel-flux-core-mig-welding-wire-003-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/office_computer_desks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:19:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-4w-x-82h-red>: HTTP status code is not handled or not allowed
2026-01-10 17:19:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forney-tweco-style-mig-welding-nozzle-for-85341-size-12>: HTTP status code is not handled or not allowed
2026-01-10 17:19:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-rear-a-for-factory-cat-28-754l>: HTTP status code is not handled or not allowed
2026-01-10 17:19:31 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/welding/filler_metals/brazing_soldering_filler_metal> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/welding/filler_metals/brazing_soldering_filler_metal landed on page that is not a product page.
2026-01-10 17:19:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-squeegee-set-for-factory-cat-28-770u-factory-cat-28-754u-factory-cat-28-755u>: HTTP status code is not handled or not allowed
2026-01-10 17:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/foodservice_disposables/takeout_containers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:19:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paperboard-pizza-boxes16w-x-16d-x-1-7-8h-white-100-carton>: HTTP status code is not handled or not allowed
2026-01-10 17:19:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/salvage-drum-li-er-85-gallon-steel-drums>: HTTP status code is not handled or not allowed
2026-01-10 17:19:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s102022-wire-rope-sling-3-4-x-12-eye-and-eye-8200-11200-22400-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:19:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electronic-push-pull-dynamometer-100-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:19:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electronic-push-pull-dynamometer-50-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:19:38 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/desks_workstations/office_computer_desks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/desks_workstations/office_computer_desks landed on page that is not a product page.
2026-01-10 17:19:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-rear-a-for-nobles-tennant-630296>: HTTP status code is not handled or not allowed
2026-01-10 17:19:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropelene-strapping-kit-postal-kit-plus-1-2-inches-x-0-018-inches-x-3000-feet-white-4-inches-x-6-inches-core>: HTTP status code is not handled or not allowed
2026-01-10 17:19:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-corner-protectors-cp101-5-1-4-inches-x-11-1-2-inches-black>: HTTP status code is not handled or not allowed
2026-01-10 17:19:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/foodservice/foodservice_disposables/takeout_containers>: HTTP status code is not handled or not allowed
2026-01-10 17:19:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-drain-hose-w-squeeze-cuff-drain-cap-full-assembly-for-nilfisk-advance-56381924>: HTTP status code is not handled or not allowed
2026-01-10 17:19:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-w-x-30-d-x-1-3-4-thick-steel-square-edge-workbench-top-12-gauge-steel-black>: HTTP status code is not handled or not allowed
2026-01-10 17:19:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forney-tweco-style-gas-diffuser-size-2-916>: HTTP status code is not handled or not allowed
2026-01-10 17:19:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duraline-economy-tubular-dunnage-rack-24-inch-w-36-inch-l-12-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 17:19:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-squeegee-set-for-nilfisk-advance-9100000810>: HTTP status code is not handled or not allowed
2026-01-10 17:19:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-signs-caution-open-door-slowly-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 17:19:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tri-pack-heavy-duty-closer-duranodic-back-check>: HTTP status code is not handled or not allowed
2026-01-10 17:19:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1833-1-2-6in-oal-hss-h-d-sand-blasted-118-point-carbide-tipped-sds-plus-3-masonry-drill>: HTTP status code is not handled or not allowed
2026-01-10 17:19:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1821-1-4-4in-oal-hss-h-d-sand-blasted-118-point-carbide-tipped-sds-plus-2-masonry-drill>: HTTP status code is not handled or not allowed
2026-01-10 17:19:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1877-39-64-black-gold-118-point-3-flat-1-2-reduced-shank-silver-deming-drill>: HTTP status code is not handled or not allowed
2026-01-10 17:19:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-climax-2c-250>: HTTP status code is not handled or not allowed
2026-01-10 17:19:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-industry-standard-clamping-couplings-climax-2iscc-125-100-s>: HTTP status code is not handled or not allowed
2026-01-10 17:19:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/krsk-knurled-rim-clamping-knob-75-191-6316-3ttt1>: HTTP status code is not handled or not allowed
2026-01-10 17:19:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-piece-repel-rain-suit-s-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:20:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1872-7-hss-heavy-duty-black-gold-135-hss-heavy-duty-parabolic-jobber-length-drill>: HTTP status code is not handled or not allowed
2026-01-10 17:20:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/werner-6-type-1a-fiberglass-podium-ladder-pd6206>: HTTP status code is not handled or not allowed
2026-01-10 17:20:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-set-screw-collar-nc-series-climax-nc-031>: HTTP status code is not handled or not allowed
2026-01-10 17:20:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s152046-8-poly-web-sling-eye-and-eye-9200-11500-23000-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:20:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-t-handle-expandable-drain-plug-for-crusader-2020>: HTTP status code is not handled or not allowed
2026-01-10 17:20:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1880-5-32-cobalt-heavy-duty-straw-135-left-hand-mechanics-length-drill>: HTTP status code is not handled or not allowed
2026-01-10 17:20:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-step-on-container-front-step-13-gallon-gray-1883602>: HTTP status code is not handled or not allowed
2026-01-10 17:20:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-safe-step-on-plastic-container-23-gallon-red-fg614600red>: HTTP status code is not handled or not allowed
2026-01-10 17:20:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1885 pages (at 92 pages/min), scraped 820 items (at 42 items/min)
2026-01-10 17:20:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cantilever-shelf-12x42-1>: HTTP status code is not handled or not allowed
2026-01-10 17:20:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-wheel-transport-cart-for-sg-4-4-steamer-6-962-239-0>: HTTP status code is not handled or not allowed
2026-01-10 17:20:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dripdrop-electrolyte-hydration-powdered-drink-mix-lemon-074-oz-100-sticksbox>: HTTP status code is not handled or not allowed
2026-01-10 17:20:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-safety-cargo-pant-44-waist-x-32l-inseam-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:20:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/southwire-67963002-nm-b-pcs-10-2-g-16-2-pegy-1000r-romex-simpull-nm-b-pcs-duo-cable-1000>: HTTP status code is not handled or not allowed
2026-01-10 17:20:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1875r-5-32-hss-h-d-black-gold-135-split-point-3-flatted-shank-mechanics-length-drill>: HTTP status code is not handled or not allowed
2026-01-10 17:20:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-flame-resistant-heavyweight-zip-up-hoodie-2xl-black>: HTTP status code is not handled or not allowed
2026-01-10 17:20:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arrow-shed-steel-woodridge-10-x-8>: HTTP status code is not handled or not allowed
2026-01-10 17:20:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-panel-wo-brackets-5712w-silver-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:20:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/siv-14-diameter-sieves>: HTTP status code is not handled or not allowed
2026-01-10 17:20:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/157-9-hss-general-purpose-bright-118-point-screw-machine-drill>: HTTP status code is not handled or not allowed
2026-01-10 17:20:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vented-plastic-shelf-72x24-nexelon-finish>: HTTP status code is not handled or not allowed
2026-01-10 17:20:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-x-22-1-2-x-1-jumbo-fold-over-mailers>: HTTP status code is not handled or not allowed
2026-01-10 17:20:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pn-12-piano-wire-whip-12l-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:20:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-vacuum-hose-for-nobles-tennant-1234534>: HTTP status code is not handled or not allowed
2026-01-10 17:20:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-partition-panel-wo-brackets-5712w-white>: HTTP status code is not handled or not allowed
2026-01-10 17:20:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-g-10-fr-4-garolite-rod-1-2-diameter-x-1-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:20:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-x-10-x-4-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:20:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tmt-cdf2-dial-deep-fryer-thermometer>: HTTP status code is not handled or not allowed
2026-01-10 17:20:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pgw-1216-pan-grate>: HTTP status code is not handled or not allowed
2026-01-10 17:20:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-recessed-screw-climax-h1c-193>: HTTP status code is not handled or not allowed
2026-01-10 17:20:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-climax-1c-100-s>: HTTP status code is not handled or not allowed
2026-01-10 17:20:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/psm-mw-medium-well-steak-markers>: HTTP status code is not handled or not allowed
2026-01-10 17:20:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-hi-vis-safety-vest-class-2-l-hi-vis-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:20:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40201-2-cld-multi-purpose-life-vest-blue-child>: HTTP status code is not handled or not allowed
2026-01-10 17:20:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ratchet-trailer-stabilizing-jack-100-100000-lb-static-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:20:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microfiber-cleaning-cloths-12-x-12-yellow-24bag>: HTTP status code is not handled or not allowed
2026-01-10 17:20:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-couplings-recessed-screw-climax-cc-100-075>: HTTP status code is not handled or not allowed
2026-01-10 17:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/shelf_trucks/aluminum_shelf_trucks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:20:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medaphene-plus-disinfectant-spray-155-oz-aerosol-spray-12carton>: HTTP status code is not handled or not allowed
2026-01-10 17:20:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dry-erase-surface-cleaner-1gal-bottle>: HTTP status code is not handled or not allowed
2026-01-10 17:20:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrosion-resistant-set-screw-collar-cr-climax-crc-009>: HTTP status code is not handled or not allowed
2026-01-10 17:20:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-x-16-x-8-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:20:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/visor-pc-green-tint-molded-10-375-inch-w-x-17-inch-l-x-098-inch-h-anti-fog-anti-scratch>: HTTP status code is not handled or not allowed
2026-01-10 17:20:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-pilaster-w-shoe-12w-x-82h-taupe>: HTTP status code is not handled or not allowed
2026-01-10 17:20:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mw-series-2-hp-solids-handling-sewage-pump>: HTTP status code is not handled or not allowed
2026-01-10 17:20:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-climax-2c-075-a>: HTTP status code is not handled or not allowed
2026-01-10 17:20:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-scrubber-12carton>: HTTP status code is not handled or not allowed
2026-01-10 17:20:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/squids-3760-phone-pouch-and-trap-clear-standard-size>: HTTP status code is not handled or not allowed
2026-01-10 17:20:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bump-cap-with-platic-suspension-white>: HTTP status code is not handled or not allowed
2026-01-10 17:20:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/shelf_trucks/aluminum_shelf_trucks>: HTTP status code is not handled or not allowed
2026-01-10 17:20:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/squids-3139-dual-double-locking-carabiner-w-swivel-black-40lbs>: HTTP status code is not handled or not allowed
2026-01-10 17:20:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tmt-mt3-dial-meat-thermometer>: HTTP status code is not handled or not allowed
2026-01-10 17:20:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ppr-2w-free-flow-pourers-white>: HTTP status code is not handled or not allowed
2026-01-10 17:20:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o-ir-higher-performance-polyolefin-cf-shrink-film-60-ga-18w-x-4375l-clear-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 17:20:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-scoop-32-oz-green>: HTTP status code is not handled or not allowed
2026-01-10 17:21:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v-gard-h2-safety-helmet-vented-climbing-class-c-type-2-white>: HTTP status code is not handled or not allowed
2026-01-10 17:21:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dwa8062f-hp-metal-cutting-wheels-type-1-4-1-2-inch-x-7-8-inch-aluminum-oxide-60-grit->: HTTP status code is not handled or not allowed
2026-01-10 17:21:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-canvas-ce-phenolic-sheet-0-750-thick-36-x-48>: HTTP status code is not handled or not allowed
2026-01-10 17:21:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optional-adjustable-height-shelf-for-rc2963-nashville-wire-cart>: HTTP status code is not handled or not allowed
2026-01-10 17:21:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phenolic-black-core-pilaster-w-shoe-22w-x-82h-folkstone-celesta>: HTTP status code is not handled or not allowed
2026-01-10 17:21:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx412511rcbl-professional-41-1-2-w-x-25-d-x-40-1-2-h-11-drawer-blue-roller-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 17:21:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patriot-fully-framed-ta-50-locker-wsolid-doors-sides-36wx24dx78h-grayunassembled>: HTTP status code is not handled or not allowed
2026-01-10 17:21:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/preventer-hd-small-heavy-duty-battery-fire-containment-bag-kit-14w-x-1d-x-10h-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:21:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 1982 pages (at 97 pages/min), scraped 864 items (at 44 items/min)
2026-01-10 17:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_partitions_stalls/plastic_laminate_bathroom_partitions already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:21:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx723019rcgnbk-250-professional-72-19-drawer-green-triple-bank-roller-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 17:21:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wbkh-7r-round-black-wire-condiment-caddy>: HTTP status code is not handled or not allowed
2026-01-10 17:21:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wbrp-30h-brush-w-hook-3w-plastic-handle>: HTTP status code is not handled or not allowed
2026-01-10 17:21:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5sh-a-2448-72-heavy-duty-adjustable-steel-shelving-24-x-48-5-shelves>: HTTP status code is not handled or not allowed
2026-01-10 17:21:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smartair-ductless-mini-split-ac-heater-18000-btu-18-seer-230v-25-installation-white>: HTTP status code is not handled or not allowed
2026-01-10 17:21:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-vented-sides-24wx18dx76h-red-all-welded>: HTTP status code is not handled or not allowed
2026-01-10 17:21:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smartair-ductless-mini-split-ac-heater-wi-fi-control-12000-btu-13-installation-kit-white>: HTTP status code is not handled or not allowed
2026-01-10 17:21:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emax-erv0150001-15-hp-rotary-screw-compressor-tankless-145-psi-70-cfm-1ph-208-230v>: HTTP status code is not handled or not allowed
2026-01-10 17:21:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-pilaster-w-shoe-5w-x-82h-navy-grafix>: HTTP status code is not handled or not allowed
2026-01-10 17:21:20 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_partitions_stalls/plastic_laminate_bathroom_partitions> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_partitions_stalls/plastic_laminate_bathroom_partitions landed on page that is not a product page.
2026-01-10 17:21:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-climax-2c-137-a>: HTTP status code is not handled or not allowed
2026-01-10 17:21:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100-grit-sand-paper-for-use-with-6-5in-pad-holder-493317-50-pack-493244>: HTTP status code is not handled or not allowed
2026-01-10 17:21:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-lb-machine-weight-for-16in-surfacing-machines-491691>: HTTP status code is not handled or not allowed
2026-01-10 17:21:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pmcp-400-measuring-cup-w-red-blue-markings-4-qt-clear-plastic>: HTTP status code is not handled or not allowed
2026-01-10 17:21:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-x-24-kra-crimped-end-tubes-case>: HTTP status code is not handled or not allowed
2026-01-10 17:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_partitions_stalls/plastic_laminate_bathroom_partitions already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:21:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-x-24-kra-3-piece-telescoping-tubes-case>: HTTP status code is not handled or not allowed
2026-01-10 17:21:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-linen-phenolic-sheet-0-093-thick-36-x-48>: HTTP status code is not handled or not allowed
2026-01-10 17:21:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/step-down-clamp-on-adaptor-sda-series-climax-sda-075>: HTTP status code is not handled or not allowed
2026-01-10 17:21:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patriot-fully-framed-ta-50-locker-wperforated-doorexpanded-side-36x24x78grall-welded>: HTTP status code is not handled or not allowed
2026-01-10 17:21:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pmsb-4-molcajete-salsa-bowls-4-oz-plastic-resin>: HTTP status code is not handled or not allowed
2026-01-10 17:21:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-paper-phenolic-sheet-0-125-thick-36-x-48>: HTTP status code is not handled or not allowed
2026-01-10 17:21:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-adhesive-caulk-10-oz-metal-gray-5113604102>: HTTP status code is not handled or not allowed
2026-01-10 17:21:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-red-buffer-pad-5100-28-in-x-14-in-10-case>: HTTP status code is not handled or not allowed
2026-01-10 17:21:37 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_partitions_stalls/plastic_laminate_bathroom_partitions> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_partitions_stalls/plastic_laminate_bathroom_partitions landed on page that is not a product page.
2026-01-10 17:21:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adhesive-sealant-w-microban-5-5-oz-clear-7079818546>: HTTP status code is not handled or not allowed
2026-01-10 17:21:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/home-seal-minimum-expanding-sealant-12-0-oz-cream-7565000082>: HTTP status code is not handled or not allowed
2026-01-10 17:21:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergodyne-skullerz-half-frame-safety-sunglasses-anti-fog-scratch-black-lens-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:21:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-40-basis-weight-kra-paper>: HTTP status code is not handled or not allowed
2026-01-10 17:21:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cbxh-1218-cutting-board-12l-18w-1h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:21:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rigid-coupling-4-set-screws-2-90-rc4h-series-climax-rc-062-kw4h90>: HTTP status code is not handled or not allowed
2026-01-10 17:21:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0385r-iron-tuff-high-bib-overall-regular-sage-small>: HTTP status code is not handled or not allowed
2026-01-10 17:21:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-7-8-x-11-7-8-stock-pad>: HTTP status code is not handled or not allowed
2026-01-10 17:21:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-couplings-recessed-screw-cc-series-climax-2cc-100-075>: HTTP status code is not handled or not allowed
2026-01-10 17:21:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-footlocker-18wx18dx78h-blue-all-welded>: HTTP status code is not handled or not allowed
2026-01-10 17:21:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wsecurity-bxfootlockervented24x24x76blall-welded>: HTTP status code is not handled or not allowed
2026-01-10 17:21:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-footlocker-vented-24wx21dx78hblall-welded>: HTTP status code is not handled or not allowed
2026-01-10 17:21:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-sided-bulk-truck-mesh-sides-4-lipped-shelves-30-48-6-poly-wheels>: HTTP status code is not handled or not allowed
2026-01-10 17:21:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-sided-shelf-truck-mesh-sides-2-adj-shlv-3600-lb-cap-24-48-6-poly-wheels>: HTTP status code is not handled or not allowed
2026-01-10 17:21:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0016-01-winston-teaspoon>: HTTP status code is not handled or not allowed
2026-01-10 17:21:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-radex-1x1-2-reducing-nipple>: HTTP status code is not handled or not allowed
2026-01-10 17:21:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelate-silver-epoxy-wire-shelf-48x14>: HTTP status code is not handled or not allowed
2026-01-10 17:21:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0385r-iron-tuff-high-bib-overall-regular-navy-small>: HTTP status code is not handled or not allowed
2026-01-10 17:21:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylindrical-roller-brush-for-kira-b50-b-60-w-bp-highlow-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:21:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bus-smoking-shelter-flat-roof-3-side-open-front-with-gray-5-gallon-outdoor-ashtray-6-5-wx3-8-dx7-h>: HTTP status code is not handled or not allowed
2026-01-10 17:21:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelfsecurity-boxvented24wx18dx72hrdunassembled>: HTTP status code is not handled or not allowed
2026-01-10 17:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:21:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0485-chillbreaker-high-bib-overall-regular-navy-4xl>: HTTP status code is not handled or not allowed
2026-01-10 17:21:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-threaded-clamping-collar-recessed-screw-climax-tc-087-09>: HTTP status code is not handled or not allowed
2026-01-10 17:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/lockers/cell_phone_box_lockers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:22:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-2-inch-fr-belt-and-buckle>: HTTP status code is not handled or not allowed
2026-01-10 17:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/gas_engines already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:22:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slimline-rectangular-trash-can-23-gal-cap-black>: HTTP status code is not handled or not allowed
2026-01-10 17:22:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0359-iron-tuff-arctic-jacket-regular-navy-small>: HTTP status code is not handled or not allowed
2026-01-10 17:22:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0031-07-peacock-oyster-fork>: HTTP status code is not handled or not allowed
2026-01-10 17:22:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0526-cooler-wear-trousers-regular-navy-large>: HTTP status code is not handled or not allowed
2026-01-10 17:22:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-radex-filter-cartridge>: HTTP status code is not handled or not allowed
2026-01-10 17:22:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/azar-300195-vertical-horizontal-door-sign-holder-5-w-x-1-4-d-x-7-h>: HTTP status code is not handled or not allowed
2026-01-10 17:22:08 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 17:22:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/max-lift-standard-scissor-lift-table-hand-operated-2000-lb-capacity-64l-x-48w>: HTTP status code is not handled or not allowed
2026-01-10 17:22:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2073 pages (at 91 pages/min), scraped 899 items (at 35 items/min)
2026-01-10 17:22:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/lockers/cell_phone_box_lockers>: HTTP status code is not handled or not allowed
2026-01-10 17:22:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/motors_power_transmission/gas_engines>: HTTP status code is not handled or not allowed
2026-01-10 17:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coveralls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:22:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-climax-1c-043-a>: HTTP status code is not handled or not allowed
2026-01-10 17:22:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-gx4-calibration-adapter>: HTTP status code is not handled or not allowed
2026-01-10 17:22:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-set-screw-collar-climax-mc-025>: HTTP status code is not handled or not allowed
2026-01-10 17:22:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rigid-coupling-4-set-screws-2-90-rc4h-series-climax-rc-175-kw4h90>: HTTP status code is not handled or not allowed
2026-01-10 17:22:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-cu-yd-yellow-self-dumping-forkli-hopper>: HTTP status code is not handled or not allowed
2026-01-10 17:22:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0034-04-stanford-bouillon-spoon>: HTTP status code is not handled or not allowed
2026-01-10 17:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:22:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-ring-chrome-barstool-with-red-seat>: HTTP status code is not handled or not allowed
2026-01-10 17:22:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bw-cf-cold-meat-fork-stainless-steel-11l>: HTTP status code is not handled or not allowed
2026-01-10 17:22:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-partition-flexible-eleven-panel-30>: HTTP status code is not handled or not allowed
2026-01-10 17:22:23 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coveralls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coveralls landed on page that is not a product page.
2026-01-10 17:22:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-l-x-30-w-14-gauge-stainless-workbench-w-undershelf-le-sink-2>: HTTP status code is not handled or not allowed
2026-01-10 17:22:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dxs2153-metric-deep-impact-socket-17mm-drive-black>: HTTP status code is not handled or not allowed
2026-01-10 17:22:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-flow-control-valve>: HTTP status code is not handled or not allowed
2026-01-10 17:22:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lugano-4-piece-patio-rattan-sofa-seating-set-with-cushions>: HTTP status code is not handled or not allowed
2026-01-10 17:22:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fiberglass-dockplate-24-18l-x-53-1316w-x-6-12h-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:22:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats>: HTTP status code is not handled or not allowed
2026-01-10 17:22:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/azar-700775-org-two-sided-pegboard-floor-display-w-adj-studio-base-17-w-x-17-d-x-70-h>: HTTP status code is not handled or not allowed
2026-01-10 17:22:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ut-7k-utility-tong-w-rubber-head-rubber-head-7l-black>: HTTP status code is not handled or not allowed
2026-01-10 17:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/respiratory_protection/powered_air_purifying_respirator_systems already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:22:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-industry-standard-clamping-couplings-climax-iscc-175-175>: HTTP status code is not handled or not allowed
2026-01-10 17:22:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/post-clamp-7-16-space-black>: HTTP status code is not handled or not allowed
2026-01-10 17:22:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-rubbermaid-brute-20-gallon-trash-container-4>: HTTP status code is not handled or not allowed
2026-01-10 17:22:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sanding-belt-aluminum-oxide-50-grit-36l-x-4w-pack-of-3>: HTTP status code is not handled or not allowed
2026-01-10 17:22:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0344l2-hivis-minus-50-suit-regular-hivis-lime-yellow-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:22:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0525-cooler-wear-jacket-regular-navy-medium>: HTTP status code is not handled or not allowed
2026-01-10 17:22:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-nova-3-hot-tube-xl-blast-jacket>: HTTP status code is not handled or not allowed
2026-01-10 17:22:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-inch-x-5-yards-self-adhesive-bandage-non-latex-orange-pack-of-8>: HTTP status code is not handled or not allowed
2026-01-10 17:22:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/respiratory_protection/powered_air_purifying_respirator_systems> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/respiratory_protection/powered_air_purifying_respirator_systems landed on page that is not a product page.
2026-01-10 17:22:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0486-hoodie-sweatshirt-regular-navy-small>: HTTP status code is not handled or not allowed
2026-01-10 17:22:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conference-arm-chair-with-casters-vinyl-black>: HTTP status code is not handled or not allowed
2026-01-10 17:22:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twp-41-steak-burger-turner-4l-blade-3-3-4w-white-polypropylene-handle>: HTTP status code is not handled or not allowed
2026-01-10 17:22:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bstop-08bp-bleed-stop-active-shooter-backpack-system-multi-use-multi-injury>: HTTP status code is not handled or not allowed
2026-01-10 17:22:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-belt-loop>: HTTP status code is not handled or not allowed
2026-01-10 17:22:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0283-insulated-high-dexterity-glove-black-large>: HTTP status code is not handled or not allowed
2026-01-10 17:22:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s90-300-10-hand-chain-hoist-3-ton-capacity-10-lift>: HTTP status code is not handled or not allowed
2026-01-10 17:22:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-filters-for-hf05-filter-fans-ip54-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 17:22:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-fork-mounted-drum-gripper>: HTTP status code is not handled or not allowed
2026-01-10 17:22:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mmb-22-rimless-bowl-22-oz-tan-melamine>: HTTP status code is not handled or not allowed
2026-01-10 17:22:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electrical-valve-lockout-kit>: HTTP status code is not handled or not allowed
2026-01-10 17:22:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-round-picnic-table-polished-gray-limestone-top-tan-river-rock-leg>: HTTP status code is not handled or not allowed
2026-01-10 17:22:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ssdb-8-double-boiler-w-cover>: HTTP status code is not handled or not allowed
2026-01-10 17:22:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-outdoor-steel-flat-bench-perforated-metal-green>: HTTP status code is not handled or not allowed
2026-01-10 17:22:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-3-tier-wire-shelving-add-on-unit-48-w-x-14-d-x-34-h>: HTTP status code is not handled or not allowed
2026-01-10 17:22:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-112-dt>: HTTP status code is not handled or not allowed
2026-01-10 17:23:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1308200-universal-blade-guide>: HTTP status code is not handled or not allowed
2026-01-10 17:23:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1113-regulator-14-npt-250-psi-gauge-not-included>: HTTP status code is not handled or not allowed
2026-01-10 17:23:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1308600-universal-nylon-markers>: HTTP status code is not handled or not allowed
2026-01-10 17:23:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n24r-osha-sign-notice-empty-cylinders-7-x-10-whiteblueblack>: HTTP status code is not handled or not allowed
2026-01-10 17:23:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-no-adhesive-50a-12-thick-x-36-wide-x-7-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:23:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d126rb-osha-sign-danger-flammable-10-x-14-whiteredblack>: HTTP status code is not handled or not allowed
2026-01-10 17:23:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-rdb-150-hydraulic-rotary-draw-tube-pipe-bender-110v>: HTTP status code is not handled or not allowed
2026-01-10 17:23:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24050-cut-off-wheel-type-1-stud-king-14-inch-x-3-32-inch-x-1-inch-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 17:23:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ccs-8f-china-cap-strainer-fine-mesh>: HTTP status code is not handled or not allowed
2026-01-10 17:23:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2169 pages (at 96 pages/min), scraped 941 items (at 42 items/min)
2026-01-10 17:23:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sslb-15-brazier-w-cover>: HTTP status code is not handled or not allowed
2026-01-10 17:23:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-tier-shelving-starter-unit-solid-galvanized-steel-54w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:23:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50128-3a-fiber-disc-5-inch-x-7-8-inch-36-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 17:23:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-1-4-x-2-5-8-6-manila-pre-wired-tag-2>: HTTP status code is not handled or not allowed
2026-01-10 17:23:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coper-notcher-for-110t-elite-ironworkers>: HTTP status code is not handled or not allowed
2026-01-10 17:23:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/28115-bench-wheel-vitrified-7-inch-x-1-inch-x-1-inch-120-grit-silicon-carbide>: HTTP status code is not handled or not allowed
2026-01-10 17:23:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9240016-universal-spinner>: HTTP status code is not handled or not allowed
2026-01-10 17:23:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coper-notcher-2013-ironworkers-older-40t-ironworkers>: HTTP status code is not handled or not allowed
2026-01-10 17:23:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-125-a>: HTTP status code is not handled or not allowed
2026-01-10 17:23:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/room-divider-6-height-7-sections-clear-acrylic-panels>: HTTP status code is not handled or not allowed
2026-01-10 17:23:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-standard-machine-table-welded-14-gauge-24-w-x-18-d-x-36-h>: HTTP status code is not handled or not allowed
2026-01-10 17:23:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-replacement-liner-24-bushel-gray-2>: HTTP status code is not handled or not allowed
2026-01-10 17:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/bulk_container_trucks_tilt_trucks/box_trucks/plastic_box_trucks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:23:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35124-psa-disc-8-inch-dia-40-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 17:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:23:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-industry-standard-clamping-couplings-climax-iscc-075-050>: HTTP status code is not handled or not allowed
2026-01-10 17:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/foodservice_carts/food_transport_carts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:23:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-frame-for-rubbermaid-tilt-truck>: HTTP status code is not handled or not allowed
2026-01-10 17:23:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-hitch-w-hardware-for-rubbermaid-towable---trainable-tilt-truck>: HTTP status code is not handled or not allowed
2026-01-10 17:23:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-sheet-with-acrylic-adhesive-70a-116-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 17:23:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-068-a>: HTTP status code is not handled or not allowed
2026-01-10 17:23:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fiberglass-tote-lid-24-3-8x14-7-8-red>: HTTP status code is not handled or not allowed
2026-01-10 17:23:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-no-adhesive-60a-116-thick-x-36-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:23:33 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/carts-trucks/bulk_container_trucks_tilt_trucks/box_trucks/plastic_box_trucks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/carts-trucks/bulk_container_trucks_tilt_trucks/box_trucks/plastic_box_trucks landed on page that is not a product page.
2026-01-10 17:23:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-brake-w-4-way-die-for-open-cavity-65t-120t-11065t-elite-ironworkers>: HTTP status code is not handled or not allowed
2026-01-10 17:23:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-cord-spring-rewind-reels-single-industrial-receptacle-35-cord-16-awg>: HTTP status code is not handled or not allowed
2026-01-10 17:23:35 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets landed on page that is not a product page.
2026-01-10 17:23:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/foodservice_carts/food_transport_carts>: HTTP status code is not handled or not allowed
2026-01-10 17:23:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/84255-water-proof-sanding-sheets-9-inch-x-11-inch-240-grit-silicon-carbide>: HTTP status code is not handled or not allowed
2026-01-10 17:23:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tn-800-end-mill-style-tube-pipe-notcher-eccentric-cut-1-3-od-1-hp-110v>: HTTP status code is not handled or not allowed
2026-01-10 17:23:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-cord-spring-rewind-reels-100-cord-12-awg-less-accessory>: HTTP status code is not handled or not allowed
2026-01-10 17:23:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/22380-depressed-center-wheel-t27-ultimate-cut-4-1-2-inch-x-045-inch-x-7-8-inch-blended>: HTTP status code is not handled or not allowed
2026-01-10 17:23:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-row-national-rep-aluminum-bleacher-21-wide-single-footboard>: HTTP status code is not handled or not allowed
2026-01-10 17:23:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-row-national-rep-aluminum-bleacher-27-wide-double-footboard>: HTTP status code is not handled or not allowed
2026-01-10 17:23:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-recessed-screw-climax-h2c-162-s>: HTTP status code is not handled or not allowed
2026-01-10 17:23:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50160-2a-fiber-disc-4-1-2-inch-x-7-8-inch-80-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 17:23:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-450-galvanized-clip-drop-forged-7-8>: HTTP status code is not handled or not allowed
2026-01-10 17:23:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-inner-air-filter-for-iafs-3000>: HTTP status code is not handled or not allowed
2026-01-10 17:23:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-stacking-bin-16-1-2-x-18-x-11-black>: HTTP status code is not handled or not allowed
2026-01-10 17:23:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tie-down-cable-5-l-butt-tainer-outdoor-ashtray>: HTTP status code is not handled or not allowed
2026-01-10 17:23:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-no-adhesive-70a-18-thick-x-36-wide-x-8-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:23:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-strip-with-acrylic-adhesive-50a-12-thick-x-2-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:23:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-429-galvanized-clip-fist-grip-1>: HTTP status code is not handled or not allowed
2026-01-10 17:23:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-industry-standard-clamping-couplings-w-keyway-climax-iscc-112-112-kw>: HTTP status code is not handled or not allowed
2026-01-10 17:23:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-no-adhesive-70a-116-thick-x-36-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:23:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-ring-economy-vinyl-view-binder-1-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 17:24:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-ring-economy-vinyl-view-binder-1-1-2-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 17:24:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tabloid-clearvue-slant-d-ring-binder-3-capacity-11-x-17-white>: HTTP status code is not handled or not allowed
2026-01-10 17:24:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-no-adhesive-70a-38-thick-x-36-wide-x-9-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:24:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-bh-61-536f-36-oz-steel-flat-hard-face-hammer-13l-handle>: HTTP status code is not handled or not allowed
2026-01-10 17:24:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/112-quad-ring-xring-12id-x-1116od-70-duro-round-black-pkg-100>: HTTP status code is not handled or not allowed
2026-01-10 17:24:05 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets landed on page that is not a product page.
2026-01-10 17:24:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n-6817-mirror-door-roller-with-1-12-inch-concave-nylon-wheel>: HTTP status code is not handled or not allowed
2026-01-10 17:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:24:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-cart-poly-green-24l-x-24w-x-40h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 17:24:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gn-749-threaded-pipe-plugs-steel-zinc-plated-with-nbr-synthetic-rubber-seal-g-1-2>: HTTP status code is not handled or not allowed
2026-01-10 17:24:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2259 pages (at 90 pages/min), scraped 979 items (at 38 items/min)
2026-01-10 17:24:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bash-2-lb-steel-dead-blow-hammer-14l-handle>: HTTP status code is not handled or not allowed
2026-01-10 17:24:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cortech-usa-7603bk-endurance-night-table-black-fr-pack-of-1>: HTTP status code is not handled or not allowed
2026-01-10 17:24:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-station-hydraulic-press-3-hp-single-phase-220v-hsp-30m-c>: HTTP status code is not handled or not allowed
2026-01-10 17:24:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locker-six-tier-12x15x12-6-door-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:24:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-hydraulic-sheet-metal-shear-7-5-hp-3-phase-220v-sh-5210-hd>: HTTP status code is not handled or not allowed
2026-01-10 17:24:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-hook-stake-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:24:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-strength-semiclear-fda-silicone-rubber-sheet-no-adhesive-50a-132-thick-x-36-w-x-24-l>: HTTP status code is not handled or not allowed
2026-01-10 17:24:18 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips landed on page that is not a product page.
2026-01-10 17:24:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-dolly-40-x-48-floor-locks>: HTTP status code is not handled or not allowed
2026-01-10 17:24:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delfin-64-longopac-hepa-vacuum-2-7-hp-mistral-202-ds-lp>: HTTP status code is not handled or not allowed
2026-01-10 17:24:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-locker-single-tier-12x12x60-3-door-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:24:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-70a-316-thick-x-36-wide-x-9-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:24:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-box-and-pan-brake-5-hp-3-phase-220v-bb-7210h>: HTTP status code is not handled or not allowed
2026-01-10 17:24:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-70a-316-thick-x-36-wide-x-6-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:24:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/front-base-15-w-x-6-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:24:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-sheet-no-adhesive-50a-116-thick-x-36-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 17:24:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-70a-14-thick-x-36-wide-x-9-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:24:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d-island-71w-x-36d-x-29-1-2h-espresso>: HTTP status code is not handled or not allowed
2026-01-10 17:24:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-sheet-with-acrylic-adhesive-60a-14-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 17:24:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/half-end-panel-12w-x-1d-x-28h-espresso>: HTTP status code is not handled or not allowed
2026-01-10 17:24:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leeson-single-phase-explosion-proof-motor-1-2hp-1140rpm-56-epfc-60hz-automatic-1-0sf-rigid>: HTTP status code is not handled or not allowed
2026-01-10 17:24:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-seal-mailer-0-6-x-10-golden-brown-25-ctn>: HTTP status code is not handled or not allowed
2026-01-10 17:24:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prime-large-moving-boxes-24l-x-15w-x-10h-kraft-blue-8-ctn>: HTTP status code is not handled or not allowed
2026-01-10 17:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:24:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-giant-stackable-storage-bin-16-1-2x18x11-green>: HTTP status code is not handled or not allowed
2026-01-10 17:24:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-tier-5-door-clear-view-locker-digital-lock-36-inch-w-x18-inch-d-x-66-inch-h-grayassembled>: HTTP status code is not handled or not allowed
2026-01-10 17:24:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-frame-sheet-panel-truck-36-x-72-w-brake-wheels>: HTTP status code is not handled or not allowed
2026-01-10 17:24:38 [py.warnings] (PID: 62) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2026-01-10 17:24:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-roll-bender-2-hp-3-phase-220v-r-m10e>: HTTP status code is not handled or not allowed
2026-01-10 17:24:38 [scrapy.extensions.feedexport] (PID: 62) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:1
2026-01-10 17:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/lockers/locker_accessories/locker_locks_keys already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:24:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-strip-no-adhesive-70a-132-thick-x-6-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:24:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-wall-corrugated-sheets-96l-x-36w-kraft-5pack>: HTTP status code is not handled or not allowed
2026-01-10 17:24:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipe-notcher-single-phase-220v-tn-200e>: HTTP status code is not handled or not allowed
2026-01-10 17:24:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manually-operated-ironworker-10-w-4-stations>: HTTP status code is not handled or not allowed
2026-01-10 17:24:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-60a-132-thick-x-36-wide-x-4-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:24:44 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips landed on page that is not a product page.
2026-01-10 17:24:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-non-resettable-combination-padlocks-no-1500kalf>: HTTP status code is not handled or not allowed
2026-01-10 17:24:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smi11-general-purpose-laboratory-incubator-double-doors-10-8-cu-ft-306-l-115v>: HTTP status code is not handled or not allowed
2026-01-10 17:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:24:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-propane-vent-free-radiant-heater-20000-btu>: HTTP status code is not handled or not allowed
2026-01-10 17:24:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/lockers/locker_accessories/locker_locks_keys>: HTTP status code is not handled or not allowed
2026-01-10 17:24:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/47-7-l-x-7-2-w-vinyl-wall-plank-gray-oak-7-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:24:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/630-516-516-3-hollow-shaft-nut-driver-w-cushion-grip>: HTTP status code is not handled or not allowed
2026-01-10 17:24:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wagon-truck-lip-deck-30-x-60-pneumatic-wheels-3000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:24:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-warded-laminated-padlocks-no-517kad>: HTTP status code is not handled or not allowed
2026-01-10 17:24:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-shelf-truck-3-flush-shelves-24-x-36>: HTTP status code is not handled or not allowed
2026-01-10 17:24:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iteq1520-duplex-circuit-breaker-type-qt-class-ctl-twin-15a-20a>: HTTP status code is not handled or not allowed
2026-01-10 17:24:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-part-carbon-style-inventory-tag-0000-0499-8-6-14l-x-3-18w-500pack>: HTTP status code is not handled or not allowed
2026-01-10 17:24:57 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets landed on page that is not a product page.
2026-01-10 17:24:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/numbered-cones-1-20-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:24:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-rubber-strip-no-adhesive-75a-14-thick-x-2-wide-x-3-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:24:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vpkwb2020-circuit-breaker-type-b-twin-1-pole-20a-20a-clamshell-packaged>: HTTP status code is not handled or not allowed
2026-01-10 17:25:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-high-security-steel-weather-resistant-covered-laminated-padlocks-no-6127lj>: HTTP status code is not handled or not allowed
2026-01-10 17:25:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s78129-class-3-hooded-sweatshirt-fluorescent-orange-4xl>: HTTP status code is not handled or not allowed
2026-01-10 17:25:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kd-jumbo-wardrobe-cabinet-48-w-x-24-d-x-78-h-medium-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:25:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-welded-combination-cabinet-36-w-x-18-d-x-72-h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:25:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1400-rubber-10-work-overshoes-black-cleated-outsole-sm>: HTTP status code is not handled or not allowed
2026-01-10 17:25:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-sheet-with-acrylic-adhesive-50a-14-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:25:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-shelving-closed-shelving-36x18x39-8>: HTTP status code is not handled or not allowed
2026-01-10 17:25:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2355 pages (at 96 pages/min), scraped 1020 items (at 41 items/min)
2026-01-10 17:25:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-jumbo-desk-height-cabinet-48-w-x-18-d-x-30-h-sand>: HTTP status code is not handled or not allowed
2026-01-10 17:25:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-shelving-closed-shelving-36x12x75-15>: HTTP status code is not handled or not allowed
2026-01-10 17:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:25:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fabricreinforced-neoprene-rubber-sheet-no-adhesive-70a-116-thick-x-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 17:25:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-ft-l-hytrol-slider-bed-conveyor-24-inch-w-belt>: HTTP status code is not handled or not allowed
2026-01-10 17:25:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluidity-02f-direct-acting-solenoid-valve-3-2-nc-nbr-seal-1-2-nptf-3-mm-24v-dc>: HTTP status code is not handled or not allowed
2026-01-10 17:25:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-strip-with-acrylic-adhesive-60a-14-thick-x-6-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:25:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hytrol-5-ft-12-inch-w-skatewheel-section-12-inch-oaw-10-wpf>: HTTP status code is not handled or not allowed
2026-01-10 17:25:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j25022-phase-3-soft-shell-jacket-fluorescent-yellowgreencharcoal-gray-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:25:18 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets landed on page that is not a product page.
2026-01-10 17:25:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x-30-in-ground-post-mounted-safety-barrier-net-kit-orange-net-yellow-posts>: HTTP status code is not handled or not allowed
2026-01-10 17:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:25:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colored-carton-sealing-tape-2-x-110-yds-22-mil-yellow-36pack>: HTTP status code is not handled or not allowed
2026-01-10 17:25:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips>: HTTP status code is not handled or not allowed
2026-01-10 17:25:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permaloc-wire-rope-sling-1-2-in-x6-ft-eye-to-eye>: HTTP status code is not handled or not allowed
2026-01-10 17:25:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluidity-02f-direct-acting-solenoid-valve-2-2-nc-epdm-seal-3-8-nptf-3-mm-110v-ac>: HTTP status code is not handled or not allowed
2026-01-10 17:25:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-part-carbonless-inventory-tag-pre-wired-9000-9499-8-6-14l-x-3-18w-500pack>: HTTP status code is not handled or not allowed
2026-01-10 17:25:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-sheet-with-acrylic-adhesive-50a-132-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 17:25:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-320-nipple-3-8-male-npt-european-interchange>: HTTP status code is not handled or not allowed
2026-01-10 17:25:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-framed-letter-board-message-center-18w-24h>: HTTP status code is not handled or not allowed
2026-01-10 17:25:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colored-carton-sealing-tape-2-x-55-yds-22-mil-orange-6pack>: HTTP status code is not handled or not allowed
2026-01-10 17:25:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips landed on page that is not a product page.
2026-01-10 17:25:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluidity-03f-hung-diaphragm-solenoid-valve-2-2-nc-fkm-seal-1-nptf-25mm-110v-ac-31va>: HTTP status code is not handled or not allowed
2026-01-10 17:25:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o23122-vision-snap-fly-front-overall-fluorescent-lime-3xl>: HTTP status code is not handled or not allowed
2026-01-10 17:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:25:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-delrin-homopolymer-sheet-1-500-thick-x-12-w-x-12-l>: HTTP status code is not handled or not allowed
2026-01-10 17:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:25:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tyvek174-shipping-tag-pre-wired-3-34l-x-1-78w-green-100pack>: HTTP status code is not handled or not allowed
2026-01-10 17:25:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-delrin-homopolymer-sheet-1-000-thick-x-24-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 17:25:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-no-adhesive-40a-14-thick-x-36-wide-x-9-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:25:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-lockable-containment-2-drum-unit>: HTTP status code is not handled or not allowed
2026-01-10 17:25:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heat-wagon-18in-long-round-flue-stack-6in-diameter-with-rain-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:25:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-large-nesting-tote-23-3-4-x-17-1-4x12-white>: HTTP status code is not handled or not allowed
2026-01-10 17:25:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lid-17-1-4x11-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:25:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-no-adhesive-40a-14-thick-x-36-wide-x-4-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:25:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls>: HTTP status code is not handled or not allowed
2026-01-10 17:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:25:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls>: HTTP status code is not handled or not allowed
2026-01-10 17:25:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j56107-durascrim-storm-fly-front-hooded-jacket-yellow-3xl>: HTTP status code is not handled or not allowed
2026-01-10 17:25:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35211-steel-toe-pvc-overshoes-blackyellow-xs>: HTTP status code is not handled or not allowed
2026-01-10 17:25:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0402-m10x1-5-d6-4-flute-bright-plug-chamfer-hand-tap>: HTTP status code is not handled or not allowed
2026-01-10 17:25:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-groundskeeper-tuscan-smokers-receptacle-black>: HTTP status code is not handled or not allowed
2026-01-10 17:25:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mb924b-neoprene-steel-toe-snugleg-boots-brick-redbrown-size-13>: HTTP status code is not handled or not allowed
2026-01-10 17:25:51 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls landed on page that is not a product page.
2026-01-10 17:25:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v70642-job-sight-twotone-class-2-vest-fluorescent-lime-lxl>: HTTP status code is not handled or not allowed
2026-01-10 17:25:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-clear-lid-18x12>: HTTP status code is not handled or not allowed
2026-01-10 17:25:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/biodegradable-cold-packs-16-oz-6-14l-x-6w-x-1h-white-36pack>: HTTP status code is not handled or not allowed
2026-01-10 17:25:53 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets landed on page that is not a product page.
2026-01-10 17:25:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tyvek174-shipping-tag-2-34l-x-1-38w-red-100pack>: HTTP status code is not handled or not allowed
2026-01-10 17:25:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slatwall-counter-top-cube-display-fixture-white-w-spinner-base>: HTTP status code is not handled or not allowed
2026-01-10 17:25:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-no-adhesive-40a-18-thick-x-36-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:25:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-sheet-no-adhesive-60a-12-thick-x-36-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:25:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylatron-nsm-rod-7-000-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:25:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/briskheat-dhcs11-silicone-heater-for-15-gallon-metal-drum-120-volts-50-425-f-heavy-duty>: HTTP status code is not handled or not allowed
2026-01-10 17:26:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-gallon-drain-evacuator>: HTTP status code is not handled or not allowed
2026-01-10 17:26:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylatron-nsm-rod-3-500-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:26:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-roloc-type-t27-zir-reg40-grit-flap-disc>: HTTP status code is not handled or not allowed
2026-01-10 17:26:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grease-system-35-lb>: HTTP status code is not handled or not allowed
2026-01-10 17:26:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tyvek174-shipping-tag-5-14l-x-2-58w-white-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/bin_shelving/steel_bin_shelving already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:26:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perm-liner-truck-16-bu-yellow-vinyl-wire-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 17:26:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/expandable-add-on-rack-60x24x84-gray-with-3-level-wood-deck-1000lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 17:26:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/expandable-add-on-rack-72x48x84-gray-with-3-level-wood-deck-750lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 17:26:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2447 pages (at 92 pages/min), scraped 1055 items (at 35 items/min)
2026-01-10 17:26:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tyvek174-shipping-tag-6-14l-x-3-18w-orange-100pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-tag-2-3-14l-x-1-58w-orange-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylatron-nsm-sheet-0-250-thick-x-24-000-w-x-48-000-l>: HTTP status code is not handled or not allowed
2026-01-10 17:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:26:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-basket-truck-24-bu-canvas-wood-base-2-rg-2-sw>: HTTP status code is not handled or not allowed
2026-01-10 17:26:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-gallon-rubbermaid-plastic-wastebasket-black>: HTTP status code is not handled or not allowed
2026-01-10 17:26:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/shelving/bin_shelving/steel_bin_shelving>: HTTP status code is not handled or not allowed
2026-01-10 17:26:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o22007-iron-eagle-plain-front-overall-gold-snaplock-buckles-lg>: HTTP status code is not handled or not allowed
2026-01-10 17:26:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mb922b-neoprene-steel-toe-snugleg-boots-brick-redbrown-size-9>: HTTP status code is not handled or not allowed
2026-01-10 17:26:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-sheet-no-adhesive-50a-12-thick-x-36-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 17:26:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tyvek174-shipping-tag-5-34l-x-2-78w-yellow-100pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-heavy-duty-600-lb-cap-safety-angle-steel-rolling-lad-grip-strut>: HTTP status code is not handled or not allowed
2026-01-10 17:26:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tygon-b44-4x-tube-3-000-id-x-3-500-od-x-50-l>: HTTP status code is not handled or not allowed
2026-01-10 17:26:23 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets landed on page that is not a product page.
2026-01-10 17:26:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sbr-rubber-sheet-with-acrylic-adhesive-75a-18-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 17:26:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/del-cone-nozzle-7-3-4-l-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:26:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infeed-exit-conveyor-for-1-2-meter>: HTTP status code is not handled or not allowed
2026-01-10 17:26:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perm-liner-truck-8-bu-gray-vinyl-wood-base-2-rg-2-sw>: HTTP status code is not handled or not allowed
2026-01-10 17:26:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-storage-locker-1-center-shelf-30-x-60>: HTTP status code is not handled or not allowed
2026-01-10 17:26:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-workbench-butcher-block-top-fixed-height-30-x-72>: HTTP status code is not handled or not allowed
2026-01-10 17:26:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-sheet-no-adhesive-60a-38-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:26:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-machine-table-30-x-36-x-24>: HTTP status code is not handled or not allowed
2026-01-10 17:26:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-tag-pre-strung-4-4-14l-x-2-18w-fluorescent-orange-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/replacement_shelves_decks/boltless_shelving_additional_shelves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:26:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-sheet-no-adhesive-50a-14-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 17:26:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-his-sheet-0-060-thick-x-48-000-w-x-96-000-l>: HTTP status code is not handled or not allowed
2026-01-10 17:26:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mb921b-neoprene-steel-toe-snugleg-boots-brick-redbrown-size-15>: HTTP status code is not handled or not allowed
2026-01-10 17:26:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-30-glass-filled-nylon-6-6-sheet-0-750-thick-x-24-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 17:26:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mh5120-light-kit-for-30-magnetic-belt-barrier>: HTTP status code is not handled or not allowed
2026-01-10 17:26:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-height-welded-workbench-w-open-base-hardboard-over-steel-24-x-48>: HTTP status code is not handled or not allowed
2026-01-10 17:26:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usb-wired-optical-quiet-click-mouse-for-mac-pc-space-gray-black-dynamousesg>: HTTP status code is not handled or not allowed
2026-01-10 17:26:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-30-glass-filled-cast-nylon-sheet-1-500-thick-x-24-000-w-x-48-000-l>: HTTP status code is not handled or not allowed
2026-01-10 17:26:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gorbel-hd-free-standing-jib-crane-12-ft-span-and-10-ft-height-under-boom-3000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:26:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boom-swing-wall-mount-ws50-4-ft-50-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:26:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vented-plastic-shelving-42x24x54-nexelon-finish>: HTTP status code is not handled or not allowed
2026-01-10 17:26:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r531007-r-baseline-twinleg-self-retracting-lifeline-7-feet-long-web-with-aluminum-rebar>: HTTP status code is not handled or not allowed
2026-01-10 17:26:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vented-plastic-shelving-54x18x63-nexelon-finish>: HTTP status code is not handled or not allowed
2026-01-10 17:26:45 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/shelving/replacement_shelves_decks/boltless_shelving_additional_shelves> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/shelving/replacement_shelves_decks/boltless_shelving_additional_shelves landed on page that is not a product page.
2026-01-10 17:26:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gift-boxes-8l-x-8w-x-8-12h-white-50pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-infinity-ventilated-steel-locker-six-tier-3-wide-12x18x12-unassembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:26:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wa-2860-e-60w-x-28d-wa-2860-e-welded-workbench-w-back-stop-end-stops>: HTTP status code is not handled or not allowed
2026-01-10 17:26:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rsb-restorer-dilutable-pine-gallon-bottle-4-bottles-904923>: HTTP status code is not handled or not allowed
2026-01-10 17:26:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/821-label-protection-tape-5-x-72-yds-25-mil-pink-8pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gloveworks-hd-diamond-textured-nitrile-industrial-gloves-m-black-100-per-box-10-box-per-cs>: HTTP status code is not handled or not allowed
2026-01-10 17:26:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-dolly-with-tilt-rollers-36-x-36-5400-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:26:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jewelry-boxes-8l-x-2w-x-78h-kraft-100pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hang-stack-bins-w-two-12-rails-six-bins-4-1-8w-x-7-3-8d-x-3h-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:26:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2515-flatback-tape-1-x-60-yds-67-mil-tan-36pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jewelry-boxes-5-14l-x-3-34w-x-78h-kraft-100pack>: HTTP status code is not handled or not allowed
2026-01-10 17:26:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-gpo-3-sheet-1-000-thick-x-24-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 17:26:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eva-tubing-w-nylon-braid-reinforcement-bulk-3-4-i-d-300-feet>: HTTP status code is not handled or not allowed
2026-01-10 17:26:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/great-lakes-tin-niagara-2-x-2-nail-up-tin-ceiling-tile-in-bronze-burst-t54-06>: HTTP status code is not handled or not allowed
2026-01-10 17:27:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/literature-organizer-modular-storage-cabinet-5>: HTTP status code is not handled or not allowed
2026-01-10 17:27:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hang-stack-bins-w-two-12-rails-four-bins-5-1-2w-x-10-7-8d-x-5h-red>: HTTP status code is not handled or not allowed
2026-01-10 17:27:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-fair-lemon-deodorant-32-oz-spray-bottle-pleasant-scent-12-bottles-case>: HTTP status code is not handled or not allowed
2026-01-10 17:27:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/great-lakes-tin-erie-2-x-2-nail-up-tin-ceiling-tile-in-matte-white-t56-01>: HTTP status code is not handled or not allowed
2026-01-10 17:27:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/362423079a-clip-s3-add-on-rack-unit-79-h-x-36-w-x-24-d-5xms230-shelves-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 17:27:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/libman-commercial-janitor-corn-broom>: HTTP status code is not handled or not allowed
2026-01-10 17:27:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-wire-add-on-54wx14dx54h>: HTTP status code is not handled or not allowed
2026-01-10 17:27:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commode-mat-2-0-absorbant-rubber-22-x-22-black-6-mats-case>: HTTP status code is not handled or not allowed
2026-01-10 17:27:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-oz-o-ring-silicone-grease-tube>: HTTP status code is not handled or not allowed
2026-01-10 17:27:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2543 pages (at 96 pages/min), scraped 1092 items (at 37 items/min)
2026-01-10 17:27:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sl300-hk2090-sl300-series-2-to-3-watt-uhf-2-channel-analog-two-way-radio>: HTTP status code is not handled or not allowed
2026-01-10 17:27:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/libman-commercial-24-inch-smooth-surface-industrial-push-broom>: HTTP status code is not handled or not allowed
2026-01-10 17:27:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gem-urinal-screen-lasts-30-days-red-spiced-apple-fragrance-12-box>: HTTP status code is not handled or not allowed
2026-01-10 17:27:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/great-lakes-tin-syracuse-2-x-2-lay-in-tin-ceiling-tile-in-gloss-white-y50-00>: HTTP status code is not handled or not allowed
2026-01-10 17:27:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultrasonic-table-top-parts-cleaning-system-digital-timer-heat-power-control-1-5-gal-132-khz-115v>: HTTP status code is not handled or not allowed
2026-01-10 17:27:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/urinal-screen-w-non-para-deodorizer-block-cherry-scent-white-pink-12-blocks-case>: HTTP status code is not handled or not allowed
2026-01-10 17:27:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/illinois-engineered-products-single-folding-gate-3w-to-4w-and-6h>: HTTP status code is not handled or not allowed
2026-01-10 17:27:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-wire-shelving-24wx14dx63h>: HTTP status code is not handled or not allowed
2026-01-10 17:27:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-aluminum-rolling-ladder-24-w-ribbed-step-30-handrails>: HTTP status code is not handled or not allowed
2026-01-10 17:27:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/great-lakes-tin-rochester-2-x-2-lay-in-tin-ceiling-tile-in-bronze-burst-y58-06>: HTTP status code is not handled or not allowed
2026-01-10 17:27:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bntm3036-30-x-36-exposed-flange-mortise-lock-prep>: HTTP status code is not handled or not allowed
2026-01-10 17:27:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cgp104648-surface-mounted-corner-guard-petg-over-aluminum-3-wing-x-4-90>: HTTP status code is not handled or not allowed
2026-01-10 17:27:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-18-ga-36-wx18-dx85-h-closed-clip-style-5-shelf-add-on>: HTTP status code is not handled or not allowed
2026-01-10 17:27:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foaming-crystal-industrial-cleaner-and-degreaser-20-oz-aerosol-12-cans-case>: HTTP status code is not handled or not allowed
2026-01-10 17:27:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/butk2424-24-x-24-exposed-flange-knurled-knob>: HTTP status code is not handled or not allowed
2026-01-10 17:27:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4210-knob-5513477>: HTTP status code is not handled or not allowed
2026-01-10 17:27:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-kit-72-w-workbench-with-18-w-whiteboard-36-w-pegboard-mounting-rail-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:27:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-casing-flexible-shaft-for-716-12-id-tubes-17l>: HTTP status code is not handled or not allowed
2026-01-10 17:27:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cloroxpro-multi-surface-disinfectant-concentrated-original-pine-80-oz-bottle3case>: HTTP status code is not handled or not allowed
2026-01-10 17:27:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hose-coupler-1>: HTTP status code is not handled or not allowed
2026-01-10 17:27:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackable-steel-container-solid-drop-gate-42l-x-35w-x-24h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:27:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mounting-bracket-for-arrow-mini-regulator-with-panel-mount-ring>: HTTP status code is not handled or not allowed
2026-01-10 17:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/dunnage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:27:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laundry-sanitizer-liquid-crisp-linen-90-oz-4-case>: HTTP status code is not handled or not allowed
2026-01-10 17:27:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-plastic-trash-container-dome-lid-garbage-can-dome-lid-32-gallon-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:27:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/concentrated-heavy-duty-floor-stripper-gallon-bottle-4-case>: HTTP status code is not handled or not allowed
2026-01-10 17:27:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/560-ergodeck-heavy-duty-outside-corner-6x15-black>: HTTP status code is not handled or not allowed
2026-01-10 17:27:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-scfm-clear-advantage-desiccant-filter-dryer>: HTTP status code is not handled or not allowed
2026-01-10 17:27:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/food-safe-motor-cfswdm3546-5e-ip69-1-hp-1760-rpm-3-ph-60-hz-56-c-3522m-tenv-f1-n>: HTTP status code is not handled or not allowed
2026-01-10 17:27:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fda-plastic-storage-container-with-lid-44-1-2-x-44-1-2-x-36>: HTTP status code is not handled or not allowed
2026-01-10 17:27:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carpet-spot-and-stain-remover-liquid-24-oz-6-per-case>: HTTP status code is not handled or not allowed
2026-01-10 17:27:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/utility_racks/dunnage_racks>: HTTP status code is not handled or not allowed
2026-01-10 17:27:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15ft-picnic-table-aluminum-planking-hd-galvanized-steel-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:27:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reechcraft-pl-xm-compact-base-powerlift-145-316-platform-height-350-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:27:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-storage-drawer-cabinet-30x27x40-2>: HTTP status code is not handled or not allowed
2026-01-10 17:27:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-propane-blue-flame-vent-free-heater-bf30pmdg-30000-btu>: HTTP status code is not handled or not allowed
2026-01-10 17:27:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-element-kit-for-arrow-midflow-filters>: HTTP status code is not handled or not allowed
2026-01-10 17:27:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-bathroom-tissue-septic-safe-2-ply-white-450-sheets-roll-75-case>: HTTP status code is not handled or not allowed
2026-01-10 17:27:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyethylene-bouffant-cap-34-mil-waterproof-100-latex-free-clear-21-100bag>: HTTP status code is not handled or not allowed
2026-01-10 17:27:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cfswdl3510-ip69-1hp-1730rpm-1ph-60hz-56c-3540l-tefc-f1-n>: HTTP status code is not handled or not allowed
2026-01-10 17:27:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8201-block-clutch-5513797>: HTTP status code is not handled or not allowed
2026-01-10 17:27:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-muffler-3-8-male>: HTTP status code is not handled or not allowed
2026-01-10 17:27:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-flame-retardant-flexible-duct-global-industrial-air-scrubber-32>: HTTP status code is not handled or not allowed
2026-01-10 17:28:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-super-quiet-flow>: HTTP status code is not handled or not allowed
2026-01-10 17:28:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laminated-polypropylene-shoe-covers-with-non-skid-aq-sole-water-resistant-white-md-200case>: HTTP status code is not handled or not allowed
2026-01-10 17:28:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-1575-1-tailgate-spreader-5-25-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 17:28:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viking153-3350-welding-helmet-5-13-shade-black>: HTTP status code is not handled or not allowed
2026-01-10 17:28:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-lab-coat-no-pockets-elastic-wrists-velcro-front-single-collar-xl-30cs>: HTTP status code is not handled or not allowed
2026-01-10 17:28:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-hairnets-dispenser-wall-mountable-4l-x-3-12w-x-5-12h>: HTTP status code is not handled or not allowed
2026-01-10 17:28:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scrubbers-tilegroutbrush-261480>: HTTP status code is not handled or not allowed
2026-01-10 17:28:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-pak-intermediate-education-welding-gear-large>: HTTP status code is not handled or not allowed
2026-01-10 17:28:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j-2550-collar-5629231>: HTTP status code is not handled or not allowed
2026-01-10 17:28:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-outdoor-wall-mounted-drinking-fountain-ss>: HTTP status code is not handled or not allowed
2026-01-10 17:28:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2640 pages (at 97 pages/min), scraped 1137 items (at 45 items/min)
2026-01-10 17:28:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-single-flavor-counter-top-soft-serve-machine>: HTTP status code is not handled or not allowed
2026-01-10 17:28:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7020-screw-516x1-34-ref-132-5713941>: HTTP status code is not handled or not allowed
2026-01-10 17:28:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8289-class-2-economy-t-shirt-orange-x-large>: HTTP status code is not handled or not allowed
2026-01-10 17:28:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hndl-grip-516-18-5631091>: HTTP status code is not handled or not allowed
2026-01-10 17:28:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pedestal-table-with-height-adjustable-legs-36x72-3>: HTTP status code is not handled or not allowed
2026-01-10 17:28:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergodyne-620-knee-sleeve-open-patella-spiral-stays-black-x-large>: HTTP status code is not handled or not allowed
2026-01-10 17:28:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cllr-5625691>: HTTP status code is not handled or not allowed
2026-01-10 17:28:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foodsafe-cfswdm3709t-e-ip69-75hp-3500rpm-3ph-60hz-213tc-3734m-tefc>: HTTP status code is not handled or not allowed
2026-01-10 17:28:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/409996-medium-carrying-case-black>: HTTP status code is not handled or not allowed
2026-01-10 17:28:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ivy-league-executive-captains-chair-with-casters-vinyl-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:28:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergodyne-600-single-layer-neoprene-knee-sleeve-black-small>: HTTP status code is not handled or not allowed
2026-01-10 17:28:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/804010a-polymer-conductivity-cell-probe>: HTTP status code is not handled or not allowed
2026-01-10 17:28:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cannes-outdoor-stackable-armchair-mineral-blue-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 17:28:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-174-battery-powered-li-truck-261022-1000-lb-60-h-24-x24-platform>: HTTP status code is not handled or not allowed
2026-01-10 17:28:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-174-battery-powered-li-truck-261025-1000-lb-60-h-30-x32-platform>: HTTP status code is not handled or not allowed
2026-01-10 17:28:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/retainer-pin-1ph-1et-1c-506>: HTTP status code is not handled or not allowed
2026-01-10 17:28:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-high-lift-skid-truck-gwk-272976-lw-fits-model-no-tshl27-33>: HTTP status code is not handled or not allowed
2026-01-10 17:28:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triumph-style-t1m-hss-mechanics-length-drill-black-bronze-oxide-116-12>: HTTP status code is not handled or not allowed
2026-01-10 17:28:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8210hl-class-2-economy-vest-orange-s-m>: HTTP status code is not handled or not allowed
2026-01-10 17:28:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-30w-x-60l-15-mil-clear-250pack>: HTTP status code is not handled or not allowed
2026-01-10 17:28:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-6w-x-18l-1-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:28:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triumph-style-t1d-hss-jobbers-drill-black-oxide-732-12>: HTTP status code is not handled or not allowed
2026-01-10 17:28:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8320z-class-3-standard-vest-orange-2xl-3xl>: HTTP status code is not handled or not allowed
2026-01-10 17:28:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rack-ring-jdp-14jmjfjsl-14d-10602304>: HTTP status code is not handled or not allowed
2026-01-10 17:28:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wicking-birdseye-t-shirt-w-pocket-class-3-hi-vis-yellow-small>: HTTP status code is not handled or not allowed
2026-01-10 17:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/labware_utensils/laboratory_vials_tubes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:28:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carpet-protection-film-36-w-x-200-l>: HTTP status code is not handled or not allowed
2026-01-10 17:28:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-cantilever-heavy-duty-shelf-24-wx60-l>: HTTP status code is not handled or not allowed
2026-01-10 17:28:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-4000-single-strap-wrist-support-tan-large-right>: HTTP status code is not handled or not allowed
2026-01-10 17:28:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/weathermaster-black-post-retracting-belt-barrier-11-ft-yellow-caution-belt>: HTTP status code is not handled or not allowed
2026-01-10 17:28:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/folding-plastic-barricade-set-of-3-panels-open-111-l-x-36-h-x-1-1-4-thick>: HTTP status code is not handled or not allowed
2026-01-10 17:28:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-sleeve-wicking-birdseye-t-shirt-w-pocket-hi-vis-yellow-2xl>: HTTP status code is not handled or not allowed
2026-01-10 17:28:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/504-40-serrated-jaw-inserts-10103s40>: HTTP status code is not handled or not allowed
2026-01-10 17:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/belt_stanchions already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:28:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-breathable-pants-hi-viz-yellow-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:28:47 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/labware_utensils/laboratory_vials_tubes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/labware_utensils/laboratory_vials_tubes landed on page that is not a product page.
2026-01-10 17:28:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/506-24-screwhd-washer-10106s24>: HTTP status code is not handled or not allowed
2026-01-10 17:28:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cart-cover-10-gauge-vinyl-for-24-x-72-x-63-unit-zipper-closure-clear>: HTTP status code is not handled or not allowed
2026-01-10 17:28:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-cap-bolt-m16-x-40-hbs-1321w-1321w-31-2>: HTTP status code is not handled or not allowed
2026-01-10 17:28:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8008-hi-vis-leg-gaiters-lime-osfa>: HTTP status code is not handled or not allowed
2026-01-10 17:28:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/security-cable-kit-includes-cable-padlock-3-keys-1>: HTTP status code is not handled or not allowed
2026-01-10 17:28:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bushing-pf3-62-6288962>: HTTP status code is not handled or not allowed
2026-01-10 17:28:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xd-smooth-aluminum-underbody-18x18x24-1706400>: HTTP status code is not handled or not allowed
2026-01-10 17:28:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-zip-down-lightweight-hoodie-hi-viz-yellow-ansi-class-2-2xl>: HTTP status code is not handled or not allowed
2026-01-10 17:28:56 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/belt_stanchions> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/belt_stanchions landed on page that is not a product page.
2026-01-10 17:28:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spindle-jdp-14mjsl-14dp-10605822>: HTTP status code is not handled or not allowed
2026-01-10 17:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/binders_covers/reports_covers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:28:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-flame-resistant-short-sleeve-t-shirt-ansi-hi-viz-yellow-4xl>: HTTP status code is not handled or not allowed
2026-01-10 17:28:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-plastic-easy-mount-frame-for-8-1-2-x-11-insert-3-pack-black>: HTTP status code is not handled or not allowed
2026-01-10 17:29:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90-degree-inside-corner-30-series>: HTTP status code is not handled or not allowed
2026-01-10 17:29:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-lightweight-crew-sweater-hi-viz-yellow-ansi-class-2-large>: HTTP status code is not handled or not allowed
2026-01-10 17:29:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-round-message-stamp-star-pre-inked-re-inkable-red>: HTTP status code is not handled or not allowed
2026-01-10 17:29:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inventory-control-cone-with-dry-erase-decal-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/binders_covers/dividers_tabs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:29:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washer-mdl-ghbbdb-1340a-32a5719>: HTTP status code is not handled or not allowed
2026-01-10 17:29:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insul-lock-self-seal-6l-1-2-thick-4-1-8>: HTTP status code is not handled or not allowed
2026-01-10 17:29:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/binders_covers/reports_covers>: HTTP status code is not handled or not allowed
2026-01-10 17:29:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2730 pages (at 90 pages/min), scraped 1174 items (at 37 items/min)
2026-01-10 17:29:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-hanging-clamps-for-blueprint-storage-rack-set-of-6>: HTTP status code is not handled or not allowed
2026-01-10 17:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/binders_covers/binders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:29:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-one-preprinted-plastic-coated-tab-dividers-12-month-tabs-letter-buff-12-set>: HTTP status code is not handled or not allowed
2026-01-10 17:29:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sparkplugs-plugstation-disp-pack-1500-per-cs-6644>: HTTP status code is not handled or not allowed
2026-01-10 17:29:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/miracool-bandanas-blue-denim-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:29:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-spreaders-steel-plastic-3-w-x-1-3-d-x-4-1-2-h>: HTTP status code is not handled or not allowed
2026-01-10 17:29:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-hp-60-gallon-230v-ingersoll-rand-air-compressor>: HTTP status code is not handled or not allowed
2026-01-10 17:29:16 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/binders_covers/dividers_tabs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/binders_covers/dividers_tabs landed on page that is not a product page.
2026-01-10 17:29:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/205675-9-hyflex-ultra-lghtweight-assembly-glove-11-801-9>: HTTP status code is not handled or not allowed
2026-01-10 17:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/panel_carts_trucks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:29:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelf-platform-30-w-x-24-d>: HTTP status code is not handled or not allowed
2026-01-10 17:29:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-soft-knee-pads-blue-6998>: HTTP status code is not handled or not allowed
2026-01-10 17:29:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/binders_covers/binders>: HTTP status code is not handled or not allowed
2026-01-10 17:29:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/411kas12prp-safety-padlock-1-12wx1-12h-purple-12set>: HTTP status code is not handled or not allowed
2026-01-10 17:29:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-edge-mechanic-nut-splitter-classes-5-6-8-3-8-10-mm-1-1-16-27-mm>: HTTP status code is not handled or not allowed
2026-01-10 17:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/paper_stationery/cash_register_pos_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:29:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/205570-7-hyflex-ultra-lightweight-assembly-glove-11-800-7>: HTTP status code is not handled or not allowed
2026-01-10 17:29:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/danger-restricted-area-authorized-employees-only-10x14-rigid-plastic>: HTTP status code is not handled or not allowed
2026-01-10 17:29:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/411kas3orj-safety-padlock-1-12w-x-1-12h-orange-3set>: HTTP status code is not handled or not allowed
2026-01-10 17:29:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-32w-x-32l-4-mil-clear-100pack>: HTTP status code is not handled or not allowed
2026-01-10 17:29:28 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/carts-trucks/panel_carts_trucks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/carts-trucks/panel_carts_trucks landed on page that is not a product page.
2026-01-10 17:29:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/411kaltprp-safety-padlock-1-12w-x-3h-shackle-purple>: HTTP status code is not handled or not allowed
2026-01-10 17:29:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/selfstick-easel-pads-unruled-25-x-30-white-2-30sheet-padscarton>: HTTP status code is not handled or not allowed
2026-01-10 17:29:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-35mm-pvc-polyester-49-coat-yellow-200cx5>: HTTP status code is not handled or not allowed
2026-01-10 17:29:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-l-x-30-w-production-bench-esd-safety-edge-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:29:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/paper_stationery/cash_register_pos_rolls>: HTTP status code is not handled or not allowed
2026-01-10 17:29:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-5w-x-38l-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:29:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/selfseal-business-envelope-window-security-tint-10-white-500box>: HTTP status code is not handled or not allowed
2026-01-10 17:29:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-in-1-plush-fleece-winter-liners-camo-6-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:29:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amana-174-rms10tsa-commercial-microwave-0-8-cu-1000-watt-touch-controls>: HTTP status code is not handled or not allowed
2026-01-10 17:29:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/needle-cover-f25-27>: HTTP status code is not handled or not allowed
2026-01-10 17:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/packaging/envelopes_mailers/shipping_envelopes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:29:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/410kas12ylw-safety-padlock-yellow-12set>: HTTP status code is not handled or not allowed
2026-01-10 17:29:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermostats-46-1371-fwet-stat-h1>: HTTP status code is not handled or not allowed
2026-01-10 17:29:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-piece-slide-ha-mmer-set-sae-5-male-adapters-3-female-adapters>: HTTP status code is not handled or not allowed
2026-01-10 17:29:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/id-label-ap3-19>: HTTP status code is not handled or not allowed
2026-01-10 17:29:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guider-seat-cos18-429>: HTTP status code is not handled or not allowed
2026-01-10 17:29:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s1106brn-aluminum-safety-padlock-1-12w-x-1-12h-shackle-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:29:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s1106orj-aluminum-safety-padlock-1-12w-x-1-12h-shackle-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:29:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/406kas3grn-safety-padlock-green-3set>: HTTP status code is not handled or not allowed
2026-01-10 17:29:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metaltech-galvanized-24-screw-jack-plate-hollow>: HTTP status code is not handled or not allowed
2026-01-10 17:29:50 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/packaging/envelopes_mailers/shipping_envelopes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/packaging/envelopes_mailers/shipping_envelopes landed on page that is not a product page.
2026-01-10 17:29:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heaters-34-1868-tru801805>: HTTP status code is not handled or not allowed
2026-01-10 17:29:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/valve-cs275-217>: HTTP status code is not handled or not allowed
2026-01-10 17:29:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/406kas12orj-safety-padlock-orange-12set>: HTTP status code is not handled or not allowed
2026-01-10 17:29:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-13w-x-18l-4-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 17:29:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elements-34-1409-apw82530100>: HTTP status code is not handled or not allowed
2026-01-10 17:29:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-28w-x-48l-6-mil-clear-50pack>: HTTP status code is not handled or not allowed
2026-01-10 17:29:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermostats-46-1155-sta2t-30402-08>: HTTP status code is not handled or not allowed
2026-01-10 17:29:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-safety-drum-with-engineer-sheeting>: HTTP status code is not handled or not allowed
2026-01-10 17:30:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mortar-board-stand-w-double-chain>: HTTP status code is not handled or not allowed
2026-01-10 17:30:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-10w-x-18l-6-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 17:30:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jet-jcdc-2-cyclone-dust-collector-2hp-230v>: HTTP status code is not handled or not allowed
2026-01-10 17:30:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-premium-locker-single-tier-12x18x72-3-door-assembled-parchment>: HTTP status code is not handled or not allowed
2026-01-10 17:30:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-sharp-tooth-lute-rake-8-snap-handle>: HTTP status code is not handled or not allowed
2026-01-10 17:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/wire_shelving/poly_zbrite_wire_shelves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:30:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-chrome-24w-x-72l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:30:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wormgear-adjustable-bull-float-bracket>: HTTP status code is not handled or not allowed
2026-01-10 17:30:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-no-hook-concrete-placer-60-alumimum-handle>: HTTP status code is not handled or not allowed
2026-01-10 17:30:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2821 pages (at 91 pages/min), scraped 1211 items (at 37 items/min)
2026-01-10 17:30:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-peen-hammers-107g>: HTTP status code is not handled or not allowed
2026-01-10 17:30:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curved-pick-hammers-156gb>: HTTP status code is not handled or not allowed
2026-01-10 17:30:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pick-hammers-156g>: HTTP status code is not handled or not allowed
2026-01-10 17:30:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-valve-14-cos18-229>: HTTP status code is not handled or not allowed
2026-01-10 17:30:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/55-136-forged-hexagonal-steep-ripping-bar-36-inch-long>: HTTP status code is not handled or not allowed
2026-01-10 17:30:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-chrome-18w-x-36l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 17:30:16 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/shelving/wire_shelving/poly_zbrite_wire_shelves> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/shelving/wire_shelving/poly_zbrite_wire_shelves landed on page that is not a product page.
2026-01-10 17:30:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-fittings-1-2-equal-union-push>: HTTP status code is not handled or not allowed
2026-01-10 17:30:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermostats-46-1209-jad4615300100>: HTTP status code is not handled or not allowed
2026-01-10 17:30:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-411-hobby-blades-for-10-401-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:30:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s1-safety-quick-coupling-3-8-industrial-interchange-with-3-8-hose-barb-connection>: HTTP status code is not handled or not allowed
2026-01-10 17:30:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-6x55-mdl-ghb-1340a-ghb1340a-150>: HTTP status code is not handled or not allowed
2026-01-10 17:30:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fuse-set-cs275-106>: HTTP status code is not handled or not allowed
2026-01-10 17:30:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f4424rtgv-econo-trough-type-3r-400x400x2400-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 17:30:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a1614nfal-junction-box-type-4x-clamp-cover-1600x1400x600>: HTTP status code is not handled or not allowed
2026-01-10 17:30:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/minigrip-slider-grip-reclosable-poly-bags-14-12w-x-16l-27-mil-clear250pk>: HTTP status code is not handled or not allowed
2026-01-10 17:30:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-step-mobile-work-platform-28in-w-x-42in-l-no-handrails-gray-wlwp032424>: HTTP status code is not handled or not allowed
2026-01-10 17:30:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adj-screw-jhs1100-122>: HTTP status code is not handled or not allowed
2026-01-10 17:30:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0-1-x-00005-0-001mm-ip65-quantumike-outside-micrometer-no-output-ratchet-thimble>: HTTP status code is not handled or not allowed
2026-01-10 17:30:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-10w-x-18l-6-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 17:30:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f44b360-barriers-qty-5-fits-400x400-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 17:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_tools/cleaning_supply_dispensers_organizers/broom_holders_shadow_boards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:30:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-316-stainless-steel-clipper-carded-hooks>: HTTP status code is not handled or not allowed
2026-01-10 17:30:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-step-24in-w-30in-d-top-step-steel-rolling-ladder-perforated-tread-36in-handrail-kdsr109246-d3>: HTTP status code is not handled or not allowed
2026-01-10 17:30:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/afk2416-floor-stand-kit-qty-2-2400x1606-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 17:30:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-3600-digital-protractor-w-rs-232-output>: HTTP status code is not handled or not allowed
2026-01-10 17:30:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-plated-brass-schedule-40-nipple-12-2-12-npt-male>: HTTP status code is not handled or not allowed
2026-01-10 17:30:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-no-vj-98-v-head-low-pipe-stand-12-max-pipe-capacity-20-38-h>: HTTP status code is not handled or not allowed
2026-01-10 17:30:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fixed-steel-ladder-guard-door-for-entry-onto-fixed-ladder-safety-yellow-opfs03-y>: HTTP status code is not handled or not allowed
2026-01-10 17:30:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-32-od-nylon-tubing-black-color-100-roll-160-500-psi>: HTTP status code is not handled or not allowed
2026-01-10 17:30:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-3w-x-9l-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:30:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-phase-compact-starter-w-start-stop-reset-1-4-2-1-amps-230-vac>: HTTP status code is not handled or not allowed
2026-01-10 17:30:43 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_tools/cleaning_supply_dispensers_organizers/broom_holders_shadow_boards> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_tools/cleaning_supply_dispensers_organizers/broom_holders_shadow_boards landed on page that is not a product page.
2026-01-10 17:30:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-ton-proto-ease-pullers-4234b>: HTTP status code is not handled or not allowed
2026-01-10 17:30:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-chrome-24w-x-30l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:30:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bench-rack-with-22-bins-2>: HTTP status code is not handled or not allowed
2026-01-10 17:30:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/easy-access-container-truck-70-h-x-36-w-x-18-d>: HTTP status code is not handled or not allowed
2026-01-10 17:30:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-36x12x72-with-5-shelves-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:30:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-speed-2-button-pendant-station-cable-gland-style>: HTTP status code is not handled or not allowed
2026-01-10 17:30:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-no-bth-9-ball-transfer-head-svj-12-max-pipe-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:30:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-36x24x72-with-4-shelves-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:30:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-no-pc-1250-scissor-style-plastic-pipetubing-cutter-18-1-58-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:30:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/retainer-ring-jsm-401-sm-40129>: HTTP status code is not handled or not allowed
2026-01-10 17:30:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8934-filament-tape-3-x-60-yds-4-mil-clear-6pack>: HTTP status code is not handled or not allowed
2026-01-10 17:30:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamp-10-inch-diameter-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:30:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ck16-301-contactor-3-pole-230v>: HTTP status code is not handled or not allowed
2026-01-10 17:30:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1300-strapping-tape-2-x-60-yds-39-mil-clear-24pack>: HTTP status code is not handled or not allowed
2026-01-10 17:31:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-nexelon-18w-x-72l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:31:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30mm-non-metallic-illuminated-extended-head-momentary-op-full-volt-push-button-red>: HTTP status code is not handled or not allowed
2026-01-10 17:31:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamp-together-manual-blast-gate-6-inch-diameter-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 17:31:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ck12-310-contactor-3-pole-230v>: HTTP status code is not handled or not allowed
2026-01-10 17:31:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knob-40-b-12-13-black-3406206>: HTTP status code is not handled or not allowed
2026-01-10 17:31:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hat-style-saddle-hanger-8-inch-diameter-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 17:31:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-chrome-18w-x-72l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:31:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamp-together-90-deg-elbow-15-clr-6-inch-diameter-glv-22-gage>: HTTP status code is not handled or not allowed
2026-01-10 17:31:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-bulk-box-6-bushel-truck-steel-chassis-base-white>: HTTP status code is not handled or not allowed
2026-01-10 17:31:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 2919 pages (at 98 pages/min), scraped 1254 items (at 43 items/min)
2026-01-10 17:31:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blue-cap-style-4-point-ratchet-suspension-hard-hat>: HTTP status code is not handled or not allowed
2026-01-10 17:31:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-rack-add-on-w-steel-decking-60-w-x-36-d-x-96-h>: HTTP status code is not handled or not allowed
2026-01-10 17:31:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-rack-add-on-w-steel-decking-96-w-x-36-d-x-144-h>: HTTP status code is not handled or not allowed
2026-01-10 17:31:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-24-plastic-square-edge-bench-top>: HTTP status code is not handled or not allowed
2026-01-10 17:31:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lanyard-loop-cord-black>: HTTP status code is not handled or not allowed
2026-01-10 17:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/footwear_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:31:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/le51a-1-2-hp-115v-19ft-shutoff-120-gpm-2-discharge-sewage-pump>: HTTP status code is not handled or not allowed
2026-01-10 17:31:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sheave-countershaft-3717053>: HTTP status code is not handled or not allowed
2026-01-10 17:31:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-w-x-15-d-lower-shelf-workbenches-black>: HTTP status code is not handled or not allowed
2026-01-10 17:31:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-precision-ground-dowel-pin-316-x-1-12-100pk>: HTTP status code is not handled or not allowed
2026-01-10 17:31:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-static-flat-poly-bags-2w-x-3l-6-mil-pink-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:31:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/44195-double-diaphragm-fuel-transfer-pump>: HTTP status code is not handled or not allowed
2026-01-10 17:31:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/turbotoe-steel-toe-cap-overshoe-3xl-15-16-flexible-pliable-pvc-antislip-sole-waterproof>: HTTP status code is not handled or not allowed
2026-01-10 17:31:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gravity-flow-rack-starter-1>: HTTP status code is not handled or not allowed
2026-01-10 17:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/paper_stationery/index_cards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:31:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/footwear_accessories>: HTTP status code is not handled or not allowed
2026-01-10 17:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/paper_stationery/index_cards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:31:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screw-jsm-403-40340>: HTTP status code is not handled or not allowed
2026-01-10 17:31:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-suffocation-warning-poly-bags-18w-x-24l-2-mil-clear-100pack>: HTTP status code is not handled or not allowed
2026-01-10 17:31:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunbrella-174-square-6-outdoor-market-umbrella-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:31:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orange-cap-style-4-point-snap-lock-suspension-hard-hat>: HTTP status code is not handled or not allowed
2026-01-10 17:31:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-foam-tape-1-x-36-yds-125-mil-white-2pack>: HTTP status code is not handled or not allowed
2026-01-10 17:31:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-gono-go-air-quality-test-kit-3000-psi-lphp-a4k>: HTTP status code is not handled or not allowed
2026-01-10 17:31:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-foot-x-6-foot-blue-tarp>: HTTP status code is not handled or not allowed
2026-01-10 17:31:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-foot-x-20-foot-blue-tarp>: HTTP status code is not handled or not allowed
2026-01-10 17:31:34 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/paper_stationery/index_cards> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/paper_stationery/index_cards landed on page that is not a product page.
2026-01-10 17:31:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cabinets-bca-364218-g-bookcase-assembled-36x18x42-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:31:35 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/paper_stationery/index_cards> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/paper_stationery/index_cards landed on page that is not a product page.
2026-01-10 17:31:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hon-310-series-4-drawer-vertical-file-26-d-letter-putty>: HTTP status code is not handled or not allowed
2026-01-10 17:31:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-foot-x-100-foot-heavy-duty-silver-tarp>: HTTP status code is not handled or not allowed
2026-01-10 17:31:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-5-way-adjustable-polyurethane-stool>: HTTP status code is not handled or not allowed
2026-01-10 17:31:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-packaging-workbench-plastic-safety-edge-60-x-30>: HTTP status code is not handled or not allowed
2026-01-10 17:31:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-hanford-triple-post-with-support-brace-no-base-lewiston-mailbox>: HTTP status code is not handled or not allowed
2026-01-10 17:31:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-foot-x-40-foot-heavy-duty-white-tarp>: HTTP status code is not handled or not allowed
2026-01-10 17:31:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-foot-x-40-foot-heavy-duty-silver-tarp>: HTTP status code is not handled or not allowed
2026-01-10 17:31:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/space-ring-2-mm-1818341>: HTTP status code is not handled or not allowed
2026-01-10 17:31:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4951-double-sided-foam-tape-34-x-5-yds-45-mil-white>: HTTP status code is not handled or not allowed
2026-01-10 17:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/full_height_storage_cabinets/stationary_storage_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:31:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/offices-to-go-bridge-48wx24dx29-1-2h-walnut>: HTTP status code is not handled or not allowed
2026-01-10 17:31:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stronghold-stainless-steel-storage-cabinet-72-x-24-x-60>: HTTP status code is not handled or not allowed
2026-01-10 17:31:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-pocket-oak-wall-rack-light-oak>: HTTP status code is not handled or not allowed
2026-01-10 17:31:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4466-double-sided-foam-tape-12-x-36-yds-625-mil-white>: HTTP status code is not handled or not allowed
2026-01-10 17:31:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/resealable-warning-poly-bags-5w-x-7l-15-mil-clear-100pack>: HTTP status code is not handled or not allowed
2026-01-10 17:31:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cardboard-corrugated-boxes-31-x-16-x-9-200-ect-32-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:31:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-cottered-pin-roller-chain-120-1c-1-1-2-pitch-50ft-reel>: HTTP status code is not handled or not allowed
2026-01-10 17:31:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strips-combo-pack-with-rubber-adhesive-1w-x-15l-black>: HTTP status code is not handled or not allowed
2026-01-10 17:31:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/cabinets/full_height_storage_cabinets/stationary_storage_cabinets>: HTTP status code is not handled or not allowed
2026-01-10 17:31:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fibre-disc-787c-120-tr-4-in-die-r400bb-25-per-inner-100-per-case>: HTTP status code is not handled or not allowed
2026-01-10 17:31:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/surface-conditioning-disc-tn-quick-change-4-1-2-x-nh-a-crs-50-per-case>: HTTP status code is not handled or not allowed
2026-01-10 17:31:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/22-7513w-6xs-cut-resistant-gloves-nitrile-micro-foam-coating-a2-b-size-6>: HTTP status code is not handled or not allowed
2026-01-10 17:31:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/feed-hndl-wheel-jmd18-042>: HTTP status code is not handled or not allowed
2026-01-10 17:32:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-style-steel-shelf-with-6-shelves-36-wx18-d-39-h>: HTTP status code is not handled or not allowed
2026-01-10 17:32:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-bands-size-84-312-x-12-155-bands1lb-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/dump_truck_inserts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:32:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/airspade-ht132-storage-case>: HTTP status code is not handled or not allowed
2026-01-10 17:32:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-binder-clips-steel-wire-38-capacity-34-wide-blacksilver-dozen>: HTTP status code is not handled or not allowed
2026-01-10 17:32:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/front-blade-reference-blade-730371-wi-31-2-b-tg>: HTTP status code is not handled or not allowed
2026-01-10 17:32:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/purofort-full-safety-mens-work-boots-size-16-green>: HTTP status code is not handled or not allowed
2026-01-10 17:32:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-double-roller-chain-25-2r-1-4-pitch-10ft-box>: HTTP status code is not handled or not allowed
2026-01-10 17:32:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3014 pages (at 95 pages/min), scraped 1295 items (at 41 items/min)
2026-01-10 17:32:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-tube-light-rl70le-36-n-led-22-26v-dc-19w-acrylic-20>: HTTP status code is not handled or not allowed
2026-01-10 17:32:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wood-crate-four-way-entry-60-l-x-48-w-x-55-12-h>: HTTP status code is not handled or not allowed
2026-01-10 17:32:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40013-spot-blaster-cast-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 17:32:13 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/dump_truck_inserts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/dump_truck_inserts landed on page that is not a product page.
2026-01-10 17:32:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/main-screw-screw-jack-sj15t-04>: HTTP status code is not handled or not allowed
2026-01-10 17:32:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/linuraedge-slim-profile-led-light-22-26v-dc-18w-acrylic-352>: HTTP status code is not handled or not allowed
2026-01-10 17:32:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/linuraedge-slim-profile-led-light-22-26v-dc-9w-acrylic-187>: HTTP status code is not handled or not allowed
2026-01-10 17:32:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polypropylene-bags-10l-x-6w-15-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:32:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/halux-universal-led-treatment-light-n50-1-p-fx-double-arm-floor-stand>: HTTP status code is not handled or not allowed
2026-01-10 17:32:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40086-spot-blaster-adapter-kit-rubber>: HTTP status code is not handled or not allowed
2026-01-10 17:32:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unsupported-6-step-40-inch-cantilever-ladder-perforated>: HTTP status code is not handled or not allowed
2026-01-10 17:32:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-174-triple-truck-gator-grip-drum-handler-attachment-261161-750-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:32:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-manual-pallet-jack-gwk-am2200-lw-fits-jungheinrich-model-am2200>: HTTP status code is not handled or not allowed
2026-01-10 17:32:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tevisio-led-39-reach-35d-8d-13w-5000k-dimmable-with-segment-switching>: HTTP status code is not handled or not allowed
2026-01-10 17:32:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-t-nut-jtm-1055-jtm1055-b58>: HTTP status code is not handled or not allowed
2026-01-10 17:32:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-174-hydraulic-li-liquid-cylinder-cart-with-hand-brake-240251-1000-lb>: HTTP status code is not handled or not allowed
2026-01-10 17:32:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits>: HTTP status code is not handled or not allowed
2026-01-10 17:32:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4000-psi-quick-connect-nozzle-0-15-25-40-degree-and-6540-soap-nozzle-5-pack-45>: HTTP status code is not handled or not allowed
2026-01-10 17:32:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-connection-jsg1052-23>: HTTP status code is not handled or not allowed
2026-01-10 17:32:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wood-weave-plate-6>: HTTP status code is not handled or not allowed
2026-01-10 17:32:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-whirlwind-box-fan-direct-drive-3-phase>: HTTP status code is not handled or not allowed
2026-01-10 17:32:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedpress-4-6-rhino-cutting-mat>: HTTP status code is not handled or not allowed
2026-01-10 17:32:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-typhoon-exhaust-slant-wall-belt-drive-no-cone>: HTTP status code is not handled or not allowed
2026-01-10 17:32:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-fan-with-wall-ceiling-bracket-black>: HTTP status code is not handled or not allowed
2026-01-10 17:32:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-polypropylene-bags-4l-x-3w-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:32:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-block-reclosable-poly-bags-2w-x-6l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:32:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kimtech-science-kimwipes-delicate-task-wipers-4-4-10-x-8-4-10-280-box>: HTTP status code is not handled or not allowed
2026-01-10 17:32:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40267sm-filter-bag-polyester-felt>: HTTP status code is not handled or not allowed
2026-01-10 17:32:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40165-nut-and-bolt-assembly-for-the-sealing-blocks-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:32:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40002-90-lb-portable-pressure-blaster-deadman-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:32:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-packing-workbench-plastic-square-edge-60-x-36>: HTTP status code is not handled or not allowed
2026-01-10 17:32:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/resealable-polypropylene-bags-4l-x-3w-15-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:32:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tower-salt-and-pepper-shaker-1-1-2-oz-gold-top>: HTTP status code is not handled or not allowed
2026-01-10 17:32:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speakman-anystream-hotel-5-jet-3-1-2-dia-showerhead-polished-chrome-finish-2-5-gpm>: HTTP status code is not handled or not allowed
2026-01-10 17:32:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-packing-workbench-maple-butcher-block-square-edge-60-x-36>: HTTP status code is not handled or not allowed
2026-01-10 17:32:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/method-x-asa-filament-white>: HTTP status code is not handled or not allowed
2026-01-10 17:32:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-ceiling-diffuser-2>: HTTP status code is not handled or not allowed
2026-01-10 17:32:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/packing-workbench-esd-safety-edge-60-x-36-with-riser-kit>: HTTP status code is not handled or not allowed
2026-01-10 17:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/wire_cable/electrical_wire_cable already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:32:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss-piano-wire-whip-epoxy-16>: HTTP status code is not handled or not allowed
2026-01-10 17:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/wire_cable/electrical_wire_cable already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:32:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-step-aluminum-rolling-ladder-24inw-grip-strut-tread-14ind-top-step-42in-handrails-wlar112245c>: HTTP status code is not handled or not allowed
2026-01-10 17:32:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-filter-assembly-t45e-global-261990-641250-floor-scrubbers>: HTTP status code is not handled or not allowed
2026-01-10 17:32:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dandux-fda-approved-plastic-bulk-container-step-wall-16-bushel-natural>: HTTP status code is not handled or not allowed
2026-01-10 17:32:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-electric-packing-workbench-maple-butcher-block-safety-edge-60-x-36>: HTTP status code is not handled or not allowed
2026-01-10 17:32:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vl22-syspend-vl-motion-arm-22-in-672x255x35-alumgray>: HTTP status code is not handled or not allowed
2026-01-10 17:32:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-mobile-packing-workbench-plastic-square-edge-with-electric-72-x-36>: HTTP status code is not handled or not allowed
2026-01-10 17:32:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-removable-foam-tape-1-x-36-yds-625-mil-white-12pack>: HTTP status code is not handled or not allowed
2026-01-10 17:32:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/wire_cable/electrical_wire_cable>: HTTP status code is not handled or not allowed
2026-01-10 17:33:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/wire_cable/electrical_wire_cable>: HTTP status code is not handled or not allowed
2026-01-10 17:33:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-gpm-siphon-pump-with-onoff-flow-ctrl>: HTTP status code is not handled or not allowed
2026-01-10 17:33:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-merchandise-bags-10-10w-x-13h-white-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 17:33:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ccs2ehdlg-elbow-heavy-duty-pendant-arm-fits-45x60mm-alumltgray>: HTTP status code is not handled or not allowed
2026-01-10 17:33:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optiloc-3-sections-18>: HTTP status code is not handled or not allowed
2026-01-10 17:33:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18vx2-36v-lxt-174-li-ion-brushless-couple-shaft-power-head-w-string-trimmer-attachment>: HTTP status code is not handled or not allowed
2026-01-10 17:33:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/downrod-36-bk-color-for-cp48dw-cp56dw-cp60dw-with-67-lead-wire-and-safety-cable>: HTTP status code is not handled or not allowed
2026-01-10 17:33:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3108 pages (at 94 pages/min), scraped 1335 items (at 40 items/min)
2026-01-10 17:33:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/planet-gear-80223-14>: HTTP status code is not handled or not allowed
2026-01-10 17:33:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/command-hub-field-retrofit-kit-with-sensor-for-upgrade-of-dehumidifiers>: HTTP status code is not handled or not allowed
2026-01-10 17:33:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-men-s-industrial-cruiser-hd-105-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:33:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-steel-stack-on-desk-hutch-72w-black>: HTTP status code is not handled or not allowed
2026-01-10 17:33:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterwand-heavy-duty-30-black-foam-rubber>: HTTP status code is not handled or not allowed
2026-01-10 17:33:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-326-industrial-tricycle-26-wheels-600-lb-capacity-black-w-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 17:33:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/throttle-valve-plug-jsm5130-10>: HTTP status code is not handled or not allowed
2026-01-10 17:33:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-credenza-with-box-and-file-drawers-36w-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 17:33:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blue-grip-ll301-natural-rubber-gloves-heavy-weight-blue-1-pair-x-large-301429>: HTTP status code is not handled or not allowed
2026-01-10 17:33:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-jjp8bt-115>: HTTP status code is not handled or not allowed
2026-01-10 17:33:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/certified-174-dri-way-compound-22-lbs-container-light-citrus-scent-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:33:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterhog-fashion-mat-charcoal-6-x-16>: HTTP status code is not handled or not allowed
2026-01-10 17:33:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/janitorial-shadow-board-combo-kit-yellow-on-black-industrial-grade-aluminum-sbk107al>: HTTP status code is not handled or not allowed
2026-01-10 17:33:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cheez-it-cracker-1-1-2-oz-single-serving-snack-pack-eight-packs-box>: HTTP status code is not handled or not allowed
2026-01-10 17:33:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flange-nut-jns185-1>: HTTP status code is not handled or not allowed
2026-01-10 17:33:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-ss-316-cast-welding-spud-2-npt-female>: HTTP status code is not handled or not allowed
2026-01-10 17:33:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nl34-stanzoil-neoprene-gloves-12-l-medium-weight-1-pair-size-7-334947>: HTTP status code is not handled or not allowed
2026-01-10 17:33:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dx-power-workstation-hutch-roller-cabinet-41w-x-25d-blue-w-black-handles-trim>: HTTP status code is not handled or not allowed
2026-01-10 17:33:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-ss-304-cast-90-degree-street-elbow-14-npt-male-x-female>: HTTP status code is not handled or not allowed
2026-01-10 17:33:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a8066chfl-continuous-hinge-wquick-turn-fast-latch-type-4-800x600x600-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 17:33:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprng-1632-6293216>: HTTP status code is not handled or not allowed
2026-01-10 17:33:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx-roller-cabinet-16-drawers-84w-x-30d-x-47-38h-black-with-red-drawer-pulls>: HTTP status code is not handled or not allowed
2026-01-10 17:33:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a806chfl-continuous-hinge-wquick-turn-fast-latch-type-4-800x600x350-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 17:33:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-mechanical-turnstile-right-locked-exit-black>: HTTP status code is not handled or not allowed
2026-01-10 17:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/floor_mats/entrance_mats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:33:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-mechanical-turnstile-right-free-exit-stainless>: HTTP status code is not handled or not allowed
2026-01-10 17:33:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/certified-174-2001-153-extraction-cleaner-5-gallon>: HTTP status code is not handled or not allowed
2026-01-10 17:33:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedi-boot-straight-register-vent-boot-w-adj-hangers-for-hvac-duct-work-4-x-12-x-7>: HTTP status code is not handled or not allowed
2026-01-10 17:33:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-connector-for-clear-wall-separators>: HTTP status code is not handled or not allowed
2026-01-10 17:33:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedi-boot-90-175-register-vent-boot-w-adj-hangers-for-hvac-duct-work-4-x-12-x-8>: HTTP status code is not handled or not allowed
2026-01-10 17:33:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-wire-shelving-add-on-unit-5-tier-72w-x-18d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 17:33:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedi-boot-90-175-register-vent-boot-w-adj-hangers-for-hvac-duct-work-10-x-10-x-8>: HTTP status code is not handled or not allowed
2026-01-10 17:33:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90-176-ss-corner-guard-16-ga-3m-two-sided-tape-sq-corners-48-lx1-wx1-h>: HTTP status code is not handled or not allowed
2026-01-10 17:33:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/floor_mats/entrance_mats>: HTTP status code is not handled or not allowed
2026-01-10 17:33:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedi-grille-round-ceiling-register-field-installable-8-round-bowtie-volume-damper-12-x-12>: HTTP status code is not handled or not allowed
2026-01-10 17:33:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brass-breather-valve-with-g-1-2-pipe-thread-881-g1-2-200-ms-m>: HTTP status code is not handled or not allowed
2026-01-10 17:33:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/asg16x12x4-pull-box-screw-cover-kos-1600x1200x400-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 17:33:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-vinyl-duct-tape-3903-black-2-x-50-yd-6-3-mil-24-per-case>: HTTP status code is not handled or not allowed
2026-01-10 17:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:33:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sv10-non-powered-tablet-cart-white-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 17:33:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lcd-cart-26-lbs-capacity-two-tone-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:33:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-coupler-industrial-interchange-h-style-38-mnpt>: HTTP status code is not handled or not allowed
2026-01-10 17:33:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx-pro-power-workstation-hutch-roller-cabinet-55w-x-25d-blue-with-black-dr-pulls>: HTTP status code is not handled or not allowed
2026-01-10 17:33:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/block-slide-25a-6295467>: HTTP status code is not handled or not allowed
2026-01-10 17:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_alarms_signals/audible_alarms already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:33:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15inx2in-2-mil-recloseable-poly-bag-clear-pkg-qty-1000>: HTTP status code is not handled or not allowed
2026-01-10 17:34:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-unit-5-tier-36w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vhds26-syspend-vhds-motion-arm-26-in-1018x3065x486-ss-type-304>: HTTP status code is not handled or not allowed
2026-01-10 17:34:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights>: HTTP status code is not handled or not allowed
2026-01-10 17:34:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lcd-industrial-computer-cabinet-black-unassembled-249190jbk>: HTTP status code is not handled or not allowed
2026-01-10 17:34:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sure-dock-led-dock-alignment-traffic-light-986588>: HTTP status code is not handled or not allowed
2026-01-10 17:34:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-ke-thermaflex-flexible-hvac-duct-12-diameter-r8>: HTTP status code is not handled or not allowed
2026-01-10 17:34:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx-pro-power-workstation-hutch-roller-cabinet-72w-x-30d-matte-blk-wblk-dr-pulls>: HTTP status code is not handled or not allowed
2026-01-10 17:34:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26x12x72-solar-star-greenhouse-w-solid-polycarbonate>: HTTP status code is not handled or not allowed
2026-01-10 17:34:08 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_alarms_signals/audible_alarms> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_alarms_signals/audible_alarms landed on page that is not a product page.
2026-01-10 17:34:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cordless-impact-driver-bare-tool>: HTTP status code is not handled or not allowed
2026-01-10 17:34:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3205 pages (at 97 pages/min), scraped 1379 items (at 44 items/min)
2026-01-10 17:34:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10l-x-16w-horizontal-bandsaw-2-hp-230v-3-phase>: HTTP status code is not handled or not allowed
2026-01-10 17:34:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modine-108000-btu-steam-or-hot-water-unit-heater-with-explosion-proof-motor>: HTTP status code is not handled or not allowed
2026-01-10 17:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery/lathes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:34:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/king-pin-lock-tractor-trailers-not-keyed-alike>: HTTP status code is not handled or not allowed
2026-01-10 17:34:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-m6x10-jbos-5-6286487>: HTTP status code is not handled or not allowed
2026-01-10 17:34:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-animal-hut-61w-x-62h-x-82l>: HTTP status code is not handled or not allowed
2026-01-10 17:34:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fiberglass-stackable-tray-24-x-12-x-2-3-4-white>: HTTP status code is not handled or not allowed
2026-01-10 17:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/foam/foam_strips already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:34:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelate-silver-epoxy-wire-shelving-add-on-unit-5-tier-72w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-riser-stair-cover-60-w-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:34:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-epdm-tube-60-l-x-5-8-id-x-7-8-od-black>: HTTP status code is not handled or not allowed
2026-01-10 17:34:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-safety-net-4-foot-l-by-12-foot-w-fits-6-3-4-inches-to-7-5-8-inches-dia-brsn-412-8>: HTTP status code is not handled or not allowed
2026-01-10 17:34:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classical-a-v-belt-a43>: HTTP status code is not handled or not allowed
2026-01-10 17:34:22 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/machining/machinery/lathes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/machining/machinery/lathes landed on page that is not a product page.
2026-01-10 17:34:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/armorclad-2-layer-epoxy-floor-kit-medium-flake-broadcast-600-sq-ft-designer-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:34:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classical-cogged-ax-v-belt-ax58>: HTTP status code is not handled or not allowed
2026-01-10 17:34:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/krylon-osha-paint-safety-red>: HTTP status code is not handled or not allowed
2026-01-10 17:34:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/foam/foam_strips>: HTTP status code is not handled or not allowed
2026-01-10 17:34:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8090250252-quiet-performance-two-stage-vertical-air-compressor-75hp-80-gallon>: HTTP status code is not handled or not allowed
2026-01-10 17:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/locks_lockout_devices/lockout_tagout_devices/lockout_hasps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:34:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/51171-extra-large-metal-lock-box-steel-7-38w-x-6h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrow-3v-cogged-v-belt-3v315>: HTTP status code is not handled or not allowed
2026-01-10 17:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/foam/foam_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:34:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rise-triple-recycling-station-for-cans-bottles-paper-45-gallon-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 17:34:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classical-b-v-belt-b180>: HTTP status code is not handled or not allowed
2026-01-10 17:34:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/86555-ladder-inspecton-tag-2-sided-10pkg-polyester-3w-x-5-3-34h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-sheet-48-l-x-48-w-x-1-4-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 17:34:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelving-add-on-unit-5-tier-36w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jea-b21-knob-sprng-6285895>: HTTP status code is not handled or not allowed
2026-01-10 17:34:38 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/locks_lockout_devices/lockout_tagout_devices/lockout_hasps> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/locks_lockout_devices/lockout_tagout_devices/lockout_hasps landed on page that is not a product page.
2026-01-10 17:34:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30x12x36-solar-star-greenhouse-w-poly-ends-and-drop-down-sides-prop-heater>: HTTP status code is not handled or not allowed
2026-01-10 17:34:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelate-silver-epoxy-wire-shelving-add-on-unit-5-tier-24w-x-24d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/34x12x40-solar-star-greenhouse-w-poly-top-and-ends-roll-up-sides>: HTTP status code is not handled or not allowed
2026-01-10 17:34:40 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/foam/foam_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/foam/foam_sheets landed on page that is not a product page.
2026-01-10 17:34:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-static-safe-print-2-12l-x-1-34w-blackyellow-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:34:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelate-silver-epoxy-wire-shelving-add-on-unit-5-tier-48w-x-24d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-sheet-48-l-x-48-w-x-1-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 17:34:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/env810-env-oil-only-absorbent-boom8dia-x-10lbale4>: HTTP status code is not handled or not allowed
2026-01-10 17:34:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelate-silver-epoxy-wire-shelving-starter-unit-5-tier-42w-x-21d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-do-not-x-ray-print-5l-x-3w-fluorescent-red-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:34:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelate-silver-epoxy-wire-shelving-starter-unit-5-tier-36w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/ink_toner/laser_toner_cartridges already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:34:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-wire-shelving-add-on-unit-5-tier-24w-x-21d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-buna-n-pvc-sheet-24-l-x-12-w-x-1-4-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 17:34:52 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:34:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x-4-x-28-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:34:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/250-1-16-dia-vc-3-32-dia-7x7-vinyl-coated-galvanized-aircraft-cable>: HTTP status code is not handled or not allowed
2026-01-10 17:34:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-x-8-x-16-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:34:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/34x12x48-solar-star-greenhouse-w-poly-ends-and-drop-down-sides-gas-heater>: HTTP status code is not handled or not allowed
2026-01-10 17:34:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-x-7-x-6-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:34:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96262-rearview-mirror-hanging-tags-101-200-parking-permits-blue-2-34w-x-4-34h>: HTTP status code is not handled or not allowed
2026-01-10 17:34:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-view-greenhouse-kit-30w-x-12h-x-36l-natural-gas>: HTTP status code is not handled or not allowed
2026-01-10 17:34:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/ink_toner/laser_toner_cartridges> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/ink_toner/laser_toner_cartridges landed on page that is not a product page.
2026-01-10 17:35:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26x12x48-solar-star-greenhouse-w-poly-ends-and-drop-down-sides>: HTTP status code is not handled or not allowed
2026-01-10 17:35:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pointer-model-201planer-6012239>: HTTP status code is not handled or not allowed
2026-01-10 17:35:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gusseted-merchandise-bags-17w-x-4d-x-24h-white-500pack>: HTTP status code is not handled or not allowed
2026-01-10 17:35:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-1-2-x-12-1-2-x-6-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/spill_control_supplies/chemical_sorbents_spill_kits/spill_kits_stations already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:35:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-mixed-load-print-5l-x-3w-fluorescent-red-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:35:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pd439g-large-ear-plug-dispenser-acrylic-12w-x-13h>: HTTP status code is not handled or not allowed
2026-01-10 17:35:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-pneumatic-wheel-8x280250-4-1-roller>: HTTP status code is not handled or not allowed
2026-01-10 17:35:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-x-6-x-4-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3297 pages (at 92 pages/min), scraped 1415 items (at 36 items/min)
2026-01-10 17:35:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-x-11-x-8-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-x-15-x-8-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-pneumatic-wheel-10x340300-5-58-roller>: HTTP status code is not handled or not allowed
2026-01-10 17:35:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-versa-tech-wheel-8x2-58-roller>: HTTP status code is not handled or not allowed
2026-01-10 17:35:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/103748-handicap-reserved-parking-sign-ada-compliant-aluminum-12w-x-18h>: HTTP status code is not handled or not allowed
2026-01-10 17:35:16 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/spill_control_supplies/chemical_sorbents_spill_kits/spill_kits_stations> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/spill_control_supplies/chemical_sorbents_spill_kits/spill_kits_stations landed on page that is not a product page.
2026-01-10 17:35:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-x-10-x-14-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/foam/foam_tubes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:35:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelving-starter-unit-5-tier-54w-x-21d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 17:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:35:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sxt200-sxt-oil-only-pads15w-x-19llight-weightcase100>: HTTP status code is not handled or not allowed
2026-01-10 17:35:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-pvc-rectangular-tube-12-l-x-7-8-w-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:35:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shaft-gear-pja-g10-15-planer-6284859>: HTTP status code is not handled or not allowed
2026-01-10 17:35:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-petg-tube-72-l-x-5-8-id-x-3-4-od-clear>: HTTP status code is not handled or not allowed
2026-01-10 17:35:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-ebonite-wheel-3-12x1-516-12-oilless>: HTTP status code is not handled or not allowed
2026-01-10 17:35:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-x-12-x-7-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-x-15-x-12-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/foam/foam_tubes>: HTTP status code is not handled or not allowed
2026-01-10 17:35:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents>: HTTP status code is not handled or not allowed
2026-01-10 17:35:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/146127-cable-safety-padlock-with-label-8h-clearance-steel-cable-green>: HTTP status code is not handled or not allowed
2026-01-10 17:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/safety_lockout_identification_tags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:35:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelite-vented-plastic-shelving-starter-unit-5-tier-60w-x-24d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:35:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-mort-wheel-10x3-1-roller>: HTTP status code is not handled or not allowed
2026-01-10 17:35:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelite-vented-plastic-shelving-starter-unit-5-tier-42w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:35:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-kickback-pawl-pja-c29-15planer-6284784>: HTTP status code is not handled or not allowed
2026-01-10 17:35:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-6-inch-caster-kit-parpaccst600-for-jetstream-250-and-260>: HTTP status code is not handled or not allowed
2026-01-10 17:35:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-fan-assembly-parfanj270f0-for-jetstream-270>: HTTP status code is not handled or not allowed
2026-01-10 17:35:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-20-x-14-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-mort-wheel-9x2-1-roller>: HTTP status code is not handled or not allowed
2026-01-10 17:35:41 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/safety_lockout_identification_tags> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/safety_lockout_identification_tags landed on page that is not a product page.
2026-01-10 17:35:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-x-26-x-26-doublewall-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelon-wire-shelving-starter-unit-1-dunnage-shelf-60w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/pens already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:35:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-w-fragile-handle-w-care-thank-print-3l-x-2w-redwhiteroll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:35:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700256blu-pegboard-floor-stand-w5-c-channel-sliding-16w-x-60h-bl-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 17:35:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-heavy-duty-standard-threaded-hex-base-warning-whip-w-o-light-12-x11-orange-rectangle-flag>: HTTP status code is not handled or not allowed
2026-01-10 17:35:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cooler-backroom-shelving-e-channel-20-inch-60-inch-3-shelves>: HTTP status code is not handled or not allowed
2026-01-10 17:35:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-174-36-wide-desk-rustic-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:35:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-x-6-x-9-insulated-container>: HTTP status code is not handled or not allowed
2026-01-10 17:35:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-epdm-strip-120-l-x-1-w-x-1-thick-black-acrylic-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 17:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery/machinery_parts_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:35:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-dia-round-paper-labels-w-move-to-stock-print-fluorescent-green-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:35:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-heavy-duty-quick-disconnect-warning-whip-w-o-light-no-flag>: HTTP status code is not handled or not allowed
2026-01-10 17:35:53 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/pens> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/pens landed on page that is not a product page.
2026-01-10 17:35:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-retractable-belt-barrier-black-mount-red-belt-7-1-2-ft-l>: HTTP status code is not handled or not allowed
2026-01-10 17:35:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultem-pei-sheet-24-l-x-24-w-x-3-4-thick-amber>: HTTP status code is not handled or not allowed
2026-01-10 17:35:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21a-2-6288979>: HTTP status code is not handled or not allowed
2026-01-10 17:35:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerback-rubber-duct-5-ft-heavy-duty-single-1-12-ch>: HTTP status code is not handled or not allowed
2026-01-10 17:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:35:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/600031-spring-pusher-06875w-x-275h-clr-50-pc>: HTTP status code is not handled or not allowed
2026-01-10 17:36:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-sheet-12-l-x-12-w-x-1-8-thick-blue-detectable-60a-acrylic-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 17:36:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/machining/machinery/machinery_parts_accessories>: HTTP status code is not handled or not allowed
2026-01-10 17:36:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ada-locker-room-hardwood-bench-top-48-l-x-24-w-269880>: HTTP status code is not handled or not allowed
2026-01-10 17:36:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/consecutive-numbered-labels-2001-2500-1-12l-x-1w-blackwhite-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:36:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/516-18-x-34-hex-hd-cap-6715035>: HTTP status code is not handled or not allowed
2026-01-10 17:36:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magliner-174-retractable-underbody-truck-slider-174-ramp-track-24-wx12-l-sr2412>: HTTP status code is not handled or not allowed
2026-01-10 17:36:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x-4-x-4-mailers>: HTTP status code is not handled or not allowed
2026-01-10 17:36:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-dia-round-paper-labels-with-partial-print-fluorescent-yellow-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:36:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parker-salon-facial-chair-with-stool-black>: HTTP status code is not handled or not allowed
2026-01-10 17:36:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips>: HTTP status code is not handled or not allowed
2026-01-10 17:36:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/work-height-platform-truck-rnb2-2448-6pyah-with-lower-shelf-24-x-48-adj-height>: HTTP status code is not handled or not allowed
2026-01-10 17:36:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3386 pages (at 89 pages/min), scraped 1449 items (at 34 items/min)
2026-01-10 17:36:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-sheet-24-l-x-12-w-x-1-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 17:36:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-labels-with-empty-print-3l-x-2w-fluorescent-green-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:36:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-1-8-x-8-5-8-x1-2-1-1-1-2-2-kra-bookfold>: HTTP status code is not handled or not allowed
2026-01-10 17:36:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adj-height-pallet-stand-pdse48-6ph2fllr-48-x-48-solid-deck-and-load-retainers>: HTTP status code is not handled or not allowed
2026-01-10 17:36:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-office-partition-panel-with-partial-window-60-1-4w-x-101-1-2h-tan-gl>: HTTP status code is not handled or not allowed
2026-01-10 17:36:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nhl-philadelphia-flyers-grill-mat-14245>: HTTP status code is not handled or not allowed
2026-01-10 17:36:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tsi-upholstered-clutter-catcher-bench-seat-console-model-30015-in-vinyl-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:36:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nhl-washington-capitals-grill-mat-14253>: HTTP status code is not handled or not allowed
2026-01-10 17:36:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-non-electric-office-partition-panel-with-raceway-36-1-4w-x-101-1-2h-blue-gl>: HTTP status code is not handled or not allowed
2026-01-10 17:36:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-electric-office-partition-panel-with-partial-window-36-1-4w-x-101-1-2h-tan-gl>: HTTP status code is not handled or not allowed
2026-01-10 17:36:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-do-not-bend-print-3l-x-2w-fluorescent-red-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:36:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-1-2-drive-6-point-1-2-short>: HTTP status code is not handled or not allowed
2026-01-10 17:36:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/daddy-long-legs-side-panel-30l-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:36:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-office-partition-panel-48-1-4w-x-101-1-2h-gray-gl>: HTTP status code is not handled or not allowed
2026-01-10 17:36:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcaw808va-notice-sign-non-potable-water-10w-x-7h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 17:36:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ceramic-magnetic-hook-20-lbs-pull-nickel-chrome-plating>: HTTP status code is not handled or not allowed
2026-01-10 17:36:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/circle-mailing-labels-4-dia-clear-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:36:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-bar-48-l-x-3-4-w-x-3-4-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 17:36:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-made-in-usa-print-3l-x-2w-redwhiteblue-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:36:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-x-30-open-end-static-shielding-bags>: HTTP status code is not handled or not allowed
2026-01-10 17:36:33 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 17:36:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/daddy-long-legs-gable-end-14w-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:36:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desktop-direct-thermal-labels-3w-x-1l-1-core-4od-white-12pack>: HTTP status code is not handled or not allowed
2026-01-10 17:36:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-100-gauge-pvc-shrink-tubing>: HTTP status code is not handled or not allowed
2026-01-10 17:36:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-30w-solid-end-panel-green>: HTTP status code is not handled or not allowed
2026-01-10 17:36:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-door-enclosed-vinyl-tackboard-silver-w-silver-frame-24w-x-36h>: HTTP status code is not handled or not allowed
2026-01-10 17:36:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-socket-1-2-drive-21mm-6-point-short>: HTTP status code is not handled or not allowed
2026-01-10 17:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:36:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-tilt-truck-24x48-solid-wood-metal-wheels-1500>: HTTP status code is not handled or not allowed
2026-01-10 17:36:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-magnetic-wall-mount-barrier-connector-to-15-plus-banner-head>: HTTP status code is not handled or not allowed
2026-01-10 17:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:36:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-barrier-set-x5-red-double-sided-danger>: HTTP status code is not handled or not allowed
2026-01-10 17:36:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kst423-heavy-duty-aluminum-big-pocket-lockout-board-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 17:36:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tp-2015-n-20-round-floor-machine-1-5-hp-175rpm-120v-50-cord>: HTTP status code is not handled or not allowed
2026-01-10 17:36:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s153-zebra-thermal-transfer-ribbons-3-18w-x-1476l-waxresin-black-24-rollscase>: HTTP status code is not handled or not allowed
2026-01-10 17:36:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-bar-48-l-x-4-w-x-1-2-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 17:36:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/28x25-liter-under-the-counter-base-cabinet-29w-x-22d-x-35-1-2h>: HTTP status code is not handled or not allowed
2026-01-10 17:36:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mani-kare-bandages-mk0909>: HTTP status code is not handled or not allowed
2026-01-10 17:36:50 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:36:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mvhr842va-notice-sign-wheels-must-be-chocked-before-loading-or-unloading-14wx10h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 17:36:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:36:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-bar-24-l-x-3-w-x-1-8-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 17:36:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-impact-flex-socket-set-3-8-drive-6-point-short-10-piece>: HTTP status code is not handled or not allowed
2026-01-10 17:36:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-5-8-tube-od-zinc-plated-anti-vibration-cush-a-clamp>: HTTP status code is not handled or not allowed
2026-01-10 17:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:36:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d-con-disposable-bait-station-3w-x-3d-x-1-1-4h-6-carton-rac99427>: HTTP status code is not handled or not allowed
2026-01-10 17:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/foam/foam_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:36:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f6-woven-split-wrappable-sleeve-3-4-dia-50-black>: HTTP status code is not handled or not allowed
2026-01-10 17:37:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-inches-overlap-push-type-seal-for-steel-5000-per-case>: HTTP status code is not handled or not allowed
2026-01-10 17:37:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-enclosed-wire-stockpicker-truck-dolly-base-48-x-24-x-69-1000-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:37:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/msmk243vs-danger-sign-flammable-material-no-smoking-or-open-14w-x-10h-adhesive-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 17:37:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-16flexo-pet-general-purpose-sleeving-dia-250-black>: HTTP status code is not handled or not allowed
2026-01-10 17:37:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-guard-back-panel-with-flush-mount-clip-144l-x-1-14w-x-48h>: HTTP status code is not handled or not allowed
2026-01-10 17:37:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/marque-plexi-double-unit-reception-desk-workstation-124-12-x-49d-x-45-12h-noble-oak>: HTTP status code is not handled or not allowed
2026-01-10 17:37:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8flexo-pet-general-purpose-sleeving-dia-125-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:37:08 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:37:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/foam/foam_rolls>: HTTP status code is not handled or not allowed
2026-01-10 17:37:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3480 pages (at 94 pages/min), scraped 1488 items (at 39 items/min)
2026-01-10 17:37:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/split-three-socket-cross>: HTTP status code is not handled or not allowed
2026-01-10 17:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/wheelchairs_physical_aids/lumbar_support_cushions already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:37:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-socket-3-4-drive-2-3-8-6-point-short>: HTTP status code is not handled or not allowed
2026-01-10 17:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:37:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/split-single-socket-tee-2>: HTTP status code is not handled or not allowed
2026-01-10 17:37:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-sheet-12-l-x-12-w-x-1-4-thick-clear-scratch-and-uv-resistant>: HTTP status code is not handled or not allowed
2026-01-10 17:37:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamp-on-crossover-3>: HTTP status code is not handled or not allowed
2026-01-10 17:37:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mfsd929va-emergency-sign-safety-shower-graphic-14w-x-10h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 17:37:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-bar-36-l-x-1-w-x-1-16-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:37:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-railing-flange>: HTTP status code is not handled or not allowed
2026-01-10 17:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:37:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-lcd-crane-scale-with-remote-1500-lb-x-05-lb>: HTTP status code is not handled or not allowed
2026-01-10 17:37:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ntep-12x12-bench-scale-with-led-display-100-lb-x-002-lb>: HTTP status code is not handled or not allowed
2026-01-10 17:37:21 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/wheelchairs_physical_aids/lumbar_support_cushions> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/wheelchairs_physical_aids/lumbar_support_cushions landed on page that is not a product page.
2026-01-10 17:37:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:37:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pm2000t-10-table-saw-with-armorglide-30-rip-3hp-1ph-230v>: HTTP status code is not handled or not allowed
2026-01-10 17:37:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lewisbins-heavy-duty-snap-on-cover-2000-series-clear>: HTTP status code is not handled or not allowed
2026-01-10 17:37:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-bar-48-l-x-1-1-2-w-x-1-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:37:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4flexo-pet-general-purpose-sleeving-dia-250-green>: HTTP status code is not handled or not allowed
2026-01-10 17:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/outdoor_furniture/outdoor_seating/outdoor_benches/plastic_benches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:37:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3x18-2-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 17:37:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:37:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-blade-dispenser-4>: HTTP status code is not handled or not allowed
2026-01-10 17:37:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g15l-125-ff-20hp-oil-injected-rotary-screw-132-gal-tank-mnt-125psi-3ph-208-230-460v>: HTTP status code is not handled or not allowed
2026-01-10 17:37:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/38x54-1-5-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 17:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:37:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-stage-80-air-dryer-compressor-horizontal-20-gal-cap-106-cfm>: HTTP status code is not handled or not allowed
2026-01-10 17:37:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-corner-swivel-socket-member-2>: HTTP status code is not handled or not allowed
2026-01-10 17:37:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machined-type-needle-roller-bearing-metric-double-sealed-45mm-bore-58mm-od>: HTTP status code is not handled or not allowed
2026-01-10 17:37:38 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/outdoor_furniture/outdoor_seating/outdoor_benches/plastic_benches> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/outdoor_furniture/outdoor_seating/outdoor_benches/plastic_benches landed on page that is not a product page.
2026-01-10 17:37:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7x12-1-5-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 17:37:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-female-single-swivel-socket-member-1>: HTTP status code is not handled or not allowed
2026-01-10 17:37:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mnt101ctp-safety-tag-notice-pf-cardstock-25pack>: HTTP status code is not handled or not allowed
2026-01-10 17:37:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/add-on-single-handrail-socket-1>: HTTP status code is not handled or not allowed
2026-01-10 17:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:37:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speco-8-channel-network-video-recorder-with-facial-recognition--smart-analytics-4tb-storage>: HTTP status code is not handled or not allowed
2026-01-10 17:37:44 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:37:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-bar-48-l-x-4-w-x-1-4-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 17:37:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermashield-aluminized-fiberglass-tube-3-dia-100-silver>: HTTP status code is not handled or not allowed
2026-01-10 17:37:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26x30-1-5-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 17:37:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-sheet-24-l-x-24-w-x-1-4-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:37:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sentec-concentrate-odor-eliminator-pure-linen-scent-2-l-bottle-2case>: HTTP status code is not handled or not allowed
2026-01-10 17:37:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acudor-24x24-drywall-access-door>: HTTP status code is not handled or not allowed
2026-01-10 17:37:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oroad-off-road-traction-drive-cart-1000-lb-capacity-13-rubber-wheels>: HTTP status code is not handled or not allowed
2026-01-10 17:37:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acudor-18x18-aluminum-diamond-plate-floor-door-no-hinge>: HTTP status code is not handled or not allowed
2026-01-10 17:37:53 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:37:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bandit-ratchet-lever-hoist-6-ton-capacity-5-lift>: HTTP status code is not handled or not allowed
2026-01-10 17:37:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/journeyman-22-4-passengers-personnel-carrier-800-lbs-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 17:37:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-gallon-portion-control-hot-water-dispenser-h5e-dv-pc-39100>: HTTP status code is not handled or not allowed
2026-01-10 17:37:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omnimed-economy-mini-narcotic-cabinet-single-door-ambi-top-8w-x-5-5-8d-x-9h-beige>: HTTP status code is not handled or not allowed
2026-01-10 17:37:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tea-concentrate-dispenser-67-galhr>: HTTP status code is not handled or not allowed
2026-01-10 17:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:37:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omnimed-economy-narcotic-cabinet-single-door-ambi-top-2-adj-shelves16w-x-8d-x-24hbeige>: HTTP status code is not handled or not allowed
2026-01-10 17:38:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-bar-48-l-x-1-w-x-1-4-thick-clear-scratch-and-uv-resistant>: HTTP status code is not handled or not allowed
2026-01-10 17:38:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jat-820-flux-chipper-ball-lock-r8-series-4-000-bpm-92-psi-6-cfm>: HTTP status code is not handled or not allowed
2026-01-10 17:38:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omnimed-stainless-narcotic-cabinet-double-door-ambi-top-4-adj-shelves-16w-x-8d-x-24h>: HTTP status code is not handled or not allowed
2026-01-10 17:38:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-sheet-12-l-x-12-w-x-1-8-thick-gray-ps-cpvc-13>: HTTP status code is not handled or not allowed
2026-01-10 17:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:38:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/group-lock-box-with-key-and-side-window-red-s601>: HTTP status code is not handled or not allowed
2026-01-10 17:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:38:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5550102-flat-file-10-second-cut>: HTTP status code is not handled or not allowed
2026-01-10 17:38:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-bar-12-l-x-1-w-x-1-8-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:38:09 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:38:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/psdtset-pipeline-small-display-table-with-top-28l-x-16w-x-18h>: HTTP status code is not handled or not allowed
2026-01-10 17:38:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3567 pages (at 87 pages/min), scraped 1522 items (at 34 items/min)
2026-01-10 17:38:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speakman-sef-1800-ca-tw-eye-saver-eyewash-faucet>: HTTP status code is not handled or not allowed
2026-01-10 17:38:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dax-brow-pad-suspension-replacement-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:38:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ac30u000-upper-tape-head-3>: HTTP status code is not handled or not allowed
2026-01-10 17:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/hvac/air_conditioners_chillers/window_air_conditioners already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:38:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speakman-se-490-traditional-series-eyeface-wash>: HTTP status code is not handled or not allowed
2026-01-10 17:38:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:38:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:38:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardair-ultra-venturi-12-alum-ext-alloy-nozzle-short-trigger>: HTTP status code is not handled or not allowed
2026-01-10 17:38:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indooroutdoor-lcd-guardian-tv-enclosure-for-34-43-monitors-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:38:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indooroutdoor-lcd-guardian-tv-enclosure-for-67-75-monitors-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:38:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0-120-percent-saturation-calcium-chloride-salometer>: HTTP status code is not handled or not allowed
2026-01-10 17:38:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s1436s-stainless-steel-wire-shelf-36w-x-14d>: HTTP status code is not handled or not allowed
2026-01-10 17:38:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-duty-self-seal-bubble-pouches-6w-x-8l-clear-250pack>: HTTP status code is not handled or not allowed
2026-01-10 17:38:23 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/hvac/air_conditioners_chillers/window_air_conditioners> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/hvac/air_conditioners_chillers/window_air_conditioners landed on page that is not a product page.
2026-01-10 17:38:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-wire-shelf-72-x-12>: HTTP status code is not handled or not allowed
2026-01-10 17:38:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-nylon-6-12-sheet-24-l-x-12-w-x-3-8-thick-off-white>: HTTP status code is not handled or not allowed
2026-01-10 17:38:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1800-2000-specific-gravity-and-64-70-degree-baume-dual-scale-hydrometer>: HTTP status code is not handled or not allowed
2026-01-10 17:38:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-x-20-kra-mailing-tubes-with-caps-case>: HTTP status code is not handled or not allowed
2026-01-10 17:38:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1400-1625-specific-gravity-and-41-54-degree-baume-dual-scale-hydrometer>: HTTP status code is not handled or not allowed
2026-01-10 17:38:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bt-2030-all-purpose-tarp-20-x-30-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:38:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-x-26-white-mailing-tubes-with-caps-case>: HTTP status code is not handled or not allowed
2026-01-10 17:38:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dry-zone-shadow-board-green-white-68-x-30-aluminum-sb133al>: HTTP status code is not handled or not allowed
2026-01-10 17:38:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-ultimate-tuffy-presentation-station>: HTTP status code is not handled or not allowed
2026-01-10 17:38:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelate-wire-shelving-36727ep-72w-x-36d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 17:38:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freestanding-3-panel-corner-room-divider-60-x-72-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:38:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wet-zone-shadow-board-red-white-68-x-30-aluminum-sb109al>: HTTP status code is not handled or not allowed
2026-01-10 17:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:38:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gift-grade-tissue-paper-10-lbs-15w-x-20l-citrus-green-960-sheets>: HTTP status code is not handled or not allowed
2026-01-10 17:38:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-hook-magnetic-coat-holder-4w-x-6h>: HTTP status code is not handled or not allowed
2026-01-10 17:38:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-tl220-industrial-test-lead-set>: HTTP status code is not handled or not allowed
2026-01-10 17:38:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-t5-rls-replacement-test-lead-set-t5-600-t5-1000>: HTTP status code is not handled or not allowed
2026-01-10 17:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:38:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-323-400a-ac-600v-ac-dc-true-rms-clamp-meter-cat-iv-300v-cat-iii-600-v-safety-rating>: HTTP status code is not handled or not allowed
2026-01-10 17:38:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strong-hold-heavy-duty-maintenance-storage-cabinet-48x24x78-269890>: HTTP status code is not handled or not allowed
2026-01-10 17:38:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-static-foam-shippers-10w-x-12l-x-2-34d-pinkwhite-24pack>: HTTP status code is not handled or not allowed
2026-01-10 17:38:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-rod-36-l-x-2-1-4-dia-white>: HTTP status code is not handled or not allowed
2026-01-10 17:38:48 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock landed on page that is not a product page.
2026-01-10 17:38:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/virgin-kraft-paper-40-lbs-24w-x-900l-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 17:38:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shureshop-bench-w-acc-kit-portable-stainless-steel-top-60-x-29-sebring-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:38:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shureshop-bench-w-acc-kit-portable-painted-steel-top-72-x-34-gloss-black>: HTTP status code is not handled or not allowed
2026-01-10 17:38:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-shade-cloth-8-x-8>: HTTP status code is not handled or not allowed
2026-01-10 17:38:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-grease-pump-assembly-20-50lb-container-4489>: HTTP status code is not handled or not allowed
2026-01-10 17:38:53 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock landed on page that is not a product page.
2026-01-10 17:38:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-4w-8l-1-ply-endless-poly-flat-web-sling>: HTTP status code is not handled or not allowed
2026-01-10 17:38:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2500-2999-inventory-tag-2-part-carbonless-stub-style>: HTTP status code is not handled or not allowed
2026-01-10 17:38:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-ft-l-lift-out-guard-rails-light-duty>: HTTP status code is not handled or not allowed
2026-01-10 17:38:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-3-4-x-2-3-8-5-light-green-shipping-tag>: HTTP status code is not handled or not allowed
2026-01-10 17:38:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-fl-flh-series-touring-1340cc-motorcycle-battery-1980-1996-23a-12v>: HTTP status code is not handled or not allowed
2026-01-10 17:39:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-4w-12l-2-ply-eye-eye-poly-web-sling-twisted-eyes>: HTTP status code is not handled or not allowed
2026-01-10 17:39:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-tube-12-l-x-1-5-8-id-x-1-15-16-od-white>: HTTP status code is not handled or not allowed
2026-01-10 17:39:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-1w-4l-2-ply-eye-eye-poly-web-sling-twisted-eyes>: HTTP status code is not handled or not allowed
2026-01-10 17:39:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-1w-8l-2-ply-endless-poly-flat-web-sling>: HTTP status code is not handled or not allowed
2026-01-10 17:39:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roundup-1w-16l-endless-poly-roundsling-green>: HTTP status code is not handled or not allowed
2026-01-10 17:39:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-3w-4l-1-ply-eye-eye-poly-web-sling-twisted-eyes>: HTTP status code is not handled or not allowed
2026-01-10 17:39:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-72-x-36-adj-height-workbench-w-drawer-black-plastic-laminate-square-top>: HTTP status code is not handled or not allowed
2026-01-10 17:39:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-21608gz-60w-x-21d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:39:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nobles-paper-vacuum-bag-magna-twin-3000-tennant-model-3280-wide-area-vac>: HTTP status code is not handled or not allowed
2026-01-10 17:39:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3662 pages (at 95 pages/min), scraped 1563 items (at 41 items/min)
2026-01-10 17:39:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roundup-1-1-4w-16l-endless-poly-roundsling-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:39:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-add-on-24365gz-36w-x-24d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 17:39:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-tube-24-l-x-3-4-id-x-1-1-2-od-white>: HTTP status code is not handled or not allowed
2026-01-10 17:39:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-hdpe-bar-24-l-x-3-w-x-1-4-thick-white-marine>: HTTP status code is not handled or not allowed
2026-01-10 17:39:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h-b-frio-temp-freezer-verification-thermometer-25-to-5c>: HTTP status code is not handled or not allowed
2026-01-10 17:39:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-tube-12-l-x-3-4-id-x-1-od-white>: HTTP status code is not handled or not allowed
2026-01-10 17:39:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-1-4-x-1-5-8-2-manila-pre-strung-tag-1>: HTTP status code is not handled or not allowed
2026-01-10 17:39:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/52-cassius-ceiling-fan-59262-matte-silver>: HTTP status code is not handled or not allowed
2026-01-10 17:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:39:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flaskup-polypropylene-flask-holders-for-100ml-round-bottom-flasks-3pk>: HTTP status code is not handled or not allowed
2026-01-10 17:39:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-square-hook-pair-hdpe-with-structural-foam>: HTTP status code is not handled or not allowed
2026-01-10 17:39:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/non242356w-2-ply-tissue-poly-professional-towels-13-w-x-18-l-white-500-box>: HTTP status code is not handled or not allowed
2026-01-10 17:39:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-container-with-lid-28-x-22-x-16-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:39:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-round-outdoor-bar-table-designer-white-phenolic-top-silver-aluminum-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:39:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tempco-channel-strip-240v-t3-42-12l-1500w>: HTTP status code is not handled or not allowed
2026-01-10 17:39:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sw32gwuu-self-aligning-closed-linear-bearing-wresin-retainer-2id-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:39:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-x-6-orange-packing-list-enclosed-panel-face>: HTTP status code is not handled or not allowed
2026-01-10 17:39:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:39:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-1-2-x-5-1-2-blue-packing-list-enclosed-full-face>: HTTP status code is not handled or not allowed
2026-01-10 17:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:39:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tempco-304ss-immersion-1-14-613d-1000w-120v-t-stat>: HTTP status code is not handled or not allowed
2026-01-10 17:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:39:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tempco-brasscopper-immersion-2-110d-4000w-240v-t-stat>: HTTP status code is not handled or not allowed
2026-01-10 17:39:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h-b-nickel-plated-brass-armor-liquid-in-glass-thermometer-case-254mm>: HTTP status code is not handled or not allowed
2026-01-10 17:39:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-bar-48-l-x-2-w-x-3-8-thick-off-white-glass-filled>: HTTP status code is not handled or not allowed
2026-01-10 17:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:39:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-upright-frame-48d-x-120h>: HTTP status code is not handled or not allowed
2026-01-10 17:39:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36w-double-sided-wall-frame-add-on>: HTTP status code is not handled or not allowed
2026-01-10 17:39:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-round-plastic-folding-table-granite-white>: HTTP status code is not handled or not allowed
2026-01-10 17:39:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-enamel-16-oz-gloss-green-6-cans-case-16-126>: HTTP status code is not handled or not allowed
2026-01-10 17:39:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:39:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:39:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-wall-mount-wire-shelving-24w-x-24d-x-54h-3-shelf-add-on-poly-green>: HTTP status code is not handled or not allowed
2026-01-10 17:39:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/itm-2-58-22-sds-max-hollow-hammer-core-bit>: HTTP status code is not handled or not allowed
2026-01-10 17:39:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:39:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-wire-shelving-unit-black-ep-18-w-x-30-l-x-86-h>: HTTP status code is not handled or not allowed
2026-01-10 17:39:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-wire-shelves-utility-cart-silver-ep-21-w-x-42-l-x-39-h>: HTTP status code is not handled or not allowed
2026-01-10 17:39:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-x-24-40-basis-weight-kra-paper-sheets>: HTTP status code is not handled or not allowed
2026-01-10 17:39:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/undercounter-refrigerator-drawers-ucrd-29d-72w-ucrd72a-6>: HTTP status code is not handled or not allowed
2026-01-10 17:39:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/school-milk-coolers-sm-58-1-2w-sm58n>: HTTP status code is not handled or not allowed
2026-01-10 17:39:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-sheet-24-l-x-12-w-x-1-thick-off-white-glass-filled>: HTTP status code is not handled or not allowed
2026-01-10 17:39:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-wall-mount-wire-shelving-54w-x-24d-x-54h-3-shelf-add-on-poly-green>: HTTP status code is not handled or not allowed
2026-01-10 17:39:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rods-and-clips-kit-set-of-3-chrome-52-l>: HTTP status code is not handled or not allowed
2026-01-10 17:39:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-4lb-paper-bag-30lb-white-5-x-3-1-3-x-9-3-4-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:39:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kendall-howard-12u-side-mount-wall-rack>: HTTP status code is not handled or not allowed
2026-01-10 17:39:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-acetal-bar-12-l-x-2-w-x-1-2-thick-off-white-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 17:39:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-24-maple-square-edge-3-drawer-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 17:39:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aed-inspection-tags-10pack>: HTTP status code is not handled or not allowed
2026-01-10 17:39:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-partition-gray-60-1-4x60>: HTTP status code is not handled or not allowed
2026-01-10 17:40:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-astm-like-liquid-in-glass-thermometer-9f-low-pensky-martens-20-to-230f>: HTTP status code is not handled or not allowed
2026-01-10 17:40:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rugged-selfcontained-emergency-treatment-set-system>: HTTP status code is not handled or not allowed
2026-01-10 17:40:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyethylene-buchner-table-top-funnel-with-coarse-porosity-removable-plate-1025-id-8h>: HTTP status code is not handled or not allowed
2026-01-10 17:40:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-5-tier-24w-x-14d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 17:40:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-36-l-x-5-w-x-1-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 17:40:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stacking-dining-armchair-woodgrained-white-1>: HTTP status code is not handled or not allowed
2026-01-10 17:40:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dupli-color-engine-enamel-with-ceramic-gray-engine-primer-12-oz-aero>: HTTP status code is not handled or not allowed
2026-01-10 17:40:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desk-lift-3-cstr-16-x-40-lift-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:40:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/programmable-thermostat-heat-cool-off-mode-5-1-1-programmable>: HTTP status code is not handled or not allowed
2026-01-10 17:40:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3757 pages (at 95 pages/min), scraped 1604 items (at 41 items/min)
2026-01-10 17:40:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-funnel-holder-for-two-1-to-6-funnels>: HTTP status code is not handled or not allowed
2026-01-10 17:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:40:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-washer-for-pipette-pump-yellow-pipettors>: HTTP status code is not handled or not allowed
2026-01-10 17:40:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gx-100f-spherical-plain-thrust-bearing-metric-high-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:40:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-500ml-16oz-polyethylene-wash-bottles-polypropylene-cap-28mm-closure-6pk>: HTTP status code is not handled or not allowed
2026-01-10 17:40:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-heavy-duty-horse-feed-bunk-with-square-ends-60l-x-40w-x-35h>: HTTP status code is not handled or not allowed
2026-01-10 17:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:40:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-electric-baseboard-convection-heater-48-l-240-208v>: HTTP status code is not handled or not allowed
2026-01-10 17:40:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-electric-baseboard-convection-heater-84-l-277v>: HTTP status code is not handled or not allowed
2026-01-10 17:40:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-0600-0710-specific-gravity-combined-form-thermo-hydrometer>: HTTP status code is not handled or not allowed
2026-01-10 17:40:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chem-crest-14-general-purpose-wash-solution-5-gallon-pail-700014p>: HTTP status code is not handled or not allowed
2026-01-10 17:40:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lakeside-stand-3-shelves-1-drawer-300>: HTTP status code is not handled or not allowed
2026-01-10 17:40:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/x-treme-duty-stanchion-45-1-2-overall-height-black-sold-in-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 17:40:21 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 17:40:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gez-212es-2rs-spherical-plain-bearing-inch-sealed>: HTTP status code is not handled or not allowed
2026-01-10 17:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/fire_protection/smoke_carbon_monoxide_detectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:40:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sv2z-economy-class-2-solid-safety-vest-with-zipper-hi-viz-orange-m>: HTTP status code is not handled or not allowed
2026-01-10 17:40:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sv4-class-2-5-pt-breakaway-mesh-vest-hi-viz-green-2xl>: HTTP status code is not handled or not allowed
2026-01-10 17:40:26 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:40:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-disposable-plastic-pestle-3-1-2-100pk>: HTTP status code is not handled or not allowed
2026-01-10 17:40:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flarealert-standard-battery-powered-led-emergency-beacon-yellow-yb2>: HTTP status code is not handled or not allowed
2026-01-10 17:40:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-resin-chaise-white>: HTTP status code is not handled or not allowed
2026-01-10 17:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:40:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-nesting-tote-24-1-2-x-19-x-9-1-2-usda-fda-approved-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:40:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tip-me-not-36h-five-section-locker>: HTTP status code is not handled or not allowed
2026-01-10 17:40:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-sheet-24-l-x-24-w-x-3-16-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 17:40:33 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/fire_protection/smoke_carbon_monoxide_detectors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/fire_protection/smoke_carbon_monoxide_detectors landed on page that is not a product page.
2026-01-10 17:40:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/108in-wide-complete-3-in-corner-compartments-satin-brushed-ic33660-ss>: HTTP status code is not handled or not allowed
2026-01-10 17:40:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-vented-labeled-2-color-isopropanol-wm-wash-bottles-250ml-8oz-pe-w-ylw-cap-3pk>: HTTP status code is not handled or not allowed
2026-01-10 17:40:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/com-10-spherical-plain-bearing-inch-commercial-series>: HTTP status code is not handled or not allowed
2026-01-10 17:40:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-labeled-4-color-methanol-wide-mouth-wash-bottles-500ml-16oz-pe-w-green-pp-cap-4pk>: HTTP status code is not handled or not allowed
2026-01-10 17:40:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-rod-12-l-x-3-1-2-dia-off-white-glass-filled>: HTTP status code is not handled or not allowed
2026-01-10 17:40:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:40:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twelve-big-cubby-storage>: HTTP status code is not handled or not allowed
2026-01-10 17:40:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-neoprene-roll-720-l-x-12-w-x-1-8-thick-white-food-60a>: HTTP status code is not handled or not allowed
2026-01-10 17:40:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-3000-medium-outdoor-waterproof-case-w-o-foam-insert-14-1-4-l-x-11-3-4-w-x-6-3-4h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:40:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-48-l-x-2-1-2-w-x-3-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 17:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/abrasives/buffing_polishing/buffing_wheels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:40:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-24w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:40:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/junior-victorian-greenhouse-12-6l-x-7-9w-x-8-2h>: HTTP status code is not handled or not allowed
2026-01-10 17:40:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spinstar-teflon-magnetic-stirring-bar-70mm-fits-400ml-beakers-white>: HTTP status code is not handled or not allowed
2026-01-10 17:40:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-steel-outdoor-storage-shed-9-2-w-x-6-1-d-x-7-1-h>: HTTP status code is not handled or not allowed
2026-01-10 17:40:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-21-adjustable-compartment-box-11-inch-l-x-7-1-4-inch-w-x-1-3-4-inch-h-clear-2360001>: HTTP status code is not handled or not allowed
2026-01-10 17:40:49 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock landed on page that is not a product page.
2026-01-10 17:40:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-shelf-w-bullnose-15w-x-23d-glossy-black>: HTTP status code is not handled or not allowed
2026-01-10 17:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:40:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9600-45-12-inch-or-16-inch-diameter-duct-storage-bag>: HTTP status code is not handled or not allowed
2026-01-10 17:40:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spinvane-teflon-triangular-magnetic-stirring-bar-56-x-96-x-48mm-fits-1-ml-vials-white>: HTTP status code is not handled or not allowed
2026-01-10 17:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:40:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/abrasives/buffing_polishing/buffing_wheels>: HTTP status code is not handled or not allowed
2026-01-10 17:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:40:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-rod-36-l-x-1-dia-off-white-glass-filled>: HTTP status code is not handled or not allowed
2026-01-10 17:40:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-304-stainless-steel-locker-12w-x-18d-x-78h-six-tier-3-wide-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 17:40:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-24w-x-21d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 17:40:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-24-l-x-1-1-2-w-x-1-2-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 17:40:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spinplus-teflon-magnetic-stirring-bar-191-x-95mm-white>: HTTP status code is not handled or not allowed
2026-01-10 17:41:00 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers landed on page that is not a product page.
2026-01-10 17:41:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spinbar-teflon-polygon-magnetic-stirring-bar-20-x-8mm-white-without-pivot-ring>: HTTP status code is not handled or not allowed
2026-01-10 17:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/tables/training_tables already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:41:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24w-x-15d-straight-shelf-w-front-lip-chrome>: HTTP status code is not handled or not allowed
2026-01-10 17:41:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/correll-econo-line-flip-top-table-24-x-60-gray-granite>: HTTP status code is not handled or not allowed
2026-01-10 17:41:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:41:02 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 17:41:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/recyclockout-lockout-tagout-station-plug-lockout-7117>: HTTP status code is not handled or not allowed
2026-01-10 17:41:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-button-lockout-electrical-panels-7253>: HTTP status code is not handled or not allowed
2026-01-10 17:41:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-bar-24-l-x-1-w-x-3-16-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 17:41:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-group-lock-box-7299y-un>: HTTP status code is not handled or not allowed
2026-01-10 17:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:41:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lockout-tagout-hasp-24-hole-7241>: HTTP status code is not handled or not allowed
2026-01-10 17:41:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24w-x-15d-straight-shelf-w-front-lip-semi-gloss-black>: HTTP status code is not handled or not allowed
2026-01-10 17:41:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3848 pages (at 91 pages/min), scraped 1635 items (at 31 items/min)
2026-01-10 17:41:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-three-tier-locker-starter-1-wide-12w-x-12d-x-24h-unassembled-almond>: HTTP status code is not handled or not allowed
2026-01-10 17:41:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-hook-chrome>: HTTP status code is not handled or not allowed
2026-01-10 17:41:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-polypropylene-utility-tray-18-x-18-x-4>: HTTP status code is not handled or not allowed
2026-01-10 17:41:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-square-tubing-outrigger-w-universal-slotting-chrome>: HTTP status code is not handled or not allowed
2026-01-10 17:41:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-teflon-fep-straight-cover-glass-forceps-4-1-2-2pk>: HTTP status code is not handled or not allowed
2026-01-10 17:41:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-plastic-box-truck>: HTTP status code is not handled or not allowed
2026-01-10 17:41:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spray-pump-250ml-8oz-polyethylene-bottles-12pk>: HTTP status code is not handled or not allowed
2026-01-10 17:41:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-bushel-plastic-bulk-box-truck-steel-chassis-base-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:41:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/tables/training_tables> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/tables/training_tables landed on page that is not a product page.
2026-01-10 17:41:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-bushel-plastic-bulk-box-truck-steel-chassis-base-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:41:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/190051a-idis-1-tongue-interlock-switch-angled-act-2nc-1no-12npt-pe>: HTTP status code is not handled or not allowed
2026-01-10 17:41:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:41:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/190051f-idis-1-tongue-interlock-switch-flat-act-2nc-1no-12npt-pe>: HTTP status code is not handled or not allowed
2026-01-10 17:41:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spproculture-plastic-pestles-for-micro-tube-homogenizer-system-05ml-100pk>: HTTP status code is not handled or not allowed
2026-01-10 17:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/labware_utensils/laboratory_clamps_tube_fittings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:41:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/175002-hlm-ss-limit-switch-2nc-2no-12npt>: HTTP status code is not handled or not allowed
2026-01-10 17:41:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/232102-a-esl-ssl-replacement-lid-8l-x-6w-x-4h-ss>: HTTP status code is not handled or not allowed
2026-01-10 17:41:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cuso-bk-led-outdoor-emergency-light-30k-120-277v-nicad-battery-wet-loc-black>: HTTP status code is not handled or not allowed
2026-01-10 17:41:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-36-square-edge-work-bench-shop-top-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:41:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72x30-safety-maple-pedestal-workbench-with-9-drawers>: HTTP status code is not handled or not allowed
2026-01-10 17:41:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-silicone-tube-60-l-x-1-1-2-id-x-2-od-red>: HTTP status code is not handled or not allowed
2026-01-10 17:41:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-three-tier-locker-adder-1-wide-12w-x-12d-x-24h-unassembled-almond>: HTTP status code is not handled or not allowed
2026-01-10 17:41:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eq-dual-speed-electric-chain-hoist-1-ton-20-lift-23-3-8-ft-min-230v>: HTTP status code is not handled or not allowed
2026-01-10 17:41:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2w-x-7h-slatgrid-panel-semi-gloss-black>: HTTP status code is not handled or not allowed
2026-01-10 17:41:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/labware_utensils/laboratory_clamps_tube_fittings> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/labware_utensils/laboratory_clamps_tube_fittings landed on page that is not a product page.
2026-01-10 17:41:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-stirring-rod-8-plastic-6pk>: HTTP status code is not handled or not allowed
2026-01-10 17:41:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-roll-360-l-x-36-w-x-3-32-thick-black-high-strength-90a-acrylic-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 17:41:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/max-attach-polymagnet-rare-earth-disc-w-adhesive-1-00-dia-x-0-06-thick>: HTTP status code is not handled or not allowed
2026-01-10 17:41:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-labels-for-protective-labeling-system-x-11000pk>: HTTP status code is not handled or not allowed
2026-01-10 17:41:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wide-mouth-1000ml-32oz-polyethylene-wash-bottles-ylw-polypropylene-cap-53mm-closure-4pk>: HTTP status code is not handled or not allowed
2026-01-10 17:41:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-series-street-utility-marking-paint-20-oz-orange-fluorescent-20-357-12-case>: HTTP status code is not handled or not allowed
2026-01-10 17:41:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-metal-wristband-09041-black>: HTTP status code is not handled or not allowed
2026-01-10 17:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:41:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-sheet-12-l-x-12-w-x-1-2-thick-black-high-strength-90a-acrylic-adhesive-bulk-rs-h90-69>: HTTP status code is not handled or not allowed
2026-01-10 17:41:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-diameter-glass-shelf-topper-for-round-racks-clear>: HTTP status code is not handled or not allowed
2026-01-10 17:41:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-epdm-roll-720-l-x-12-w-x-3-32-thick-black-60a>: HTTP status code is not handled or not allowed
2026-01-10 17:41:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-way-base-for-grid-semi-gloss-white>: HTTP status code is not handled or not allowed
2026-01-10 17:41:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/core-cl-suture-procedure-cart-with-locking-sliding-door-white-withsilver-metallic>: HTTP status code is not handled or not allowed
2026-01-10 17:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/packaging/strapping_supplies/strapping_carts_dispensers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:41:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knurled-thumb-screw-w-shoulder-m6-x-1-0-25mm-thread-24mm-head-dia-16mm-head-h-pkg-of-5>: HTTP status code is not handled or not allowed
2026-01-10 17:41:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/additional-level-72x18-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 17:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:41:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grab-n-go-high-profile-open-display-merchandiser-78-18w-x-31-12d-x-76-78h>: HTTP status code is not handled or not allowed
2026-01-10 17:41:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls>: HTTP status code is not handled or not allowed
2026-01-10 17:41:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cm-1717-96-midnight-countertop-trash-bin-5-inch-w-x-5-inch-d-x-7-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 17:41:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-roll-1440-l-x-36-w-x-3-8-thick-black-high-strength-80a-acrylic-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 17:41:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-248ledmy240a-48-mm-led-stacklight-module-yellow-240v-ac>: HTTP status code is not handled or not allowed
2026-01-10 17:41:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/84-heavy-weight-double-slot-w-1-2-slots-on-1-centers-satin-zinc>: HTTP status code is not handled or not allowed
2026-01-10 17:41:52 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/packaging/strapping_supplies/strapping_carts_dispensers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/packaging/strapping_supplies/strapping_carts_dispensers landed on page that is not a product page.
2026-01-10 17:41:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-netting-three-bay-18>: HTTP status code is not handled or not allowed
2026-01-10 17:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:41:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-sheet-12-l-x-12-w-x-3-32-thick-black-high-strength-90a-bulk-rs-h90-18>: HTTP status code is not handled or not allowed
2026-01-10 17:41:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-economy-metal-bookends-black-enamel>: HTTP status code is not handled or not allowed
2026-01-10 17:41:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls landed on page that is not a product page.
2026-01-10 17:41:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/die-cast-adjustable-lever-1-2-13-3-07-handle-0-99-stud-black-8t25a03k-gn300>: HTTP status code is not handled or not allowed
2026-01-10 17:41:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-125xbrmb120ab-125xbr-xtra-brite-led-multi-mode-blue-120-vac>: HTTP status code is not handled or not allowed
2026-01-10 17:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:41:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clearwater-adirondack-chair-white>: HTTP status code is not handled or not allowed
2026-01-10 17:41:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/174-j20-53-7425j-153-polypropylene-label-0-5-h-x-2-w-2000-roll-white>: HTTP status code is not handled or not allowed
2026-01-10 17:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/label_tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:42:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/174-150740-inspection-timer-7-day-10-pack-led-lights-abs-plastic-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:42:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cjl1304a-5-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-hinged-top-basket-truck-10-bu-tan-vinyl-wood-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 17:42:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wedge-curb-ramp-22-w-x-24-l-600-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:42:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/174-150473-prop-65-regulatory-sign-parking-garage-14-x-10-polyester-black-on-white>: HTTP status code is not handled or not allowed
2026-01-10 17:42:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-270fb1248d-incandescentled-bulb-module-blue-12-48v-dc>: HTTP status code is not handled or not allowed
2026-01-10 17:42:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/centrifugal-blower-3000-rpm-208-240v-oao-0-28-0-25-fl-amps>: HTTP status code is not handled or not allowed
2026-01-10 17:42:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cjm3120-11-2-hp-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cm3542-3-4-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs>: HTTP status code is not handled or not allowed
2026-01-10 17:42:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/condenser-fans-motor-1-2-hp-1075-rpm-208-230v-teao-48-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:42:08 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips landed on page that is not a product page.
2026-01-10 17:42:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-105xbrmr24d-dual-mode-led-signal-red-24v-dc>: HTTP status code is not handled or not allowed
2026-01-10 17:42:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 3941 pages (at 93 pages/min), scraped 1662 items (at 27 items/min)
2026-01-10 17:42:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/label_tapes>: HTTP status code is not handled or not allowed
2026-01-10 17:42:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cwdl3504-5-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-medical-security-cabinet-with-double-key-locks>: HTTP status code is not handled or not allowed
2026-01-10 17:42:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poster-fire-extinguisher-safety-24-x-18>: HTTP status code is not handled or not allowed
2026-01-10 17:42:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/centrifugal-blower-3200-rpm-115v-oao>: HTTP status code is not handled or not allowed
2026-01-10 17:42:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-248ledmw120a-48-mm-led-stacklight-module-white-120v-ac>: HTTP status code is not handled or not allowed
2026-01-10 17:42:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-1-2-titanium-coated-tradesman-utility-shears>: HTTP status code is not handled or not allowed
2026-01-10 17:42:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-270ledg12v-led-bulb-green-12v>: HTTP status code is not handled or not allowed
2026-01-10 17:42:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90-tooth-flex-head-teardrop-ratchet-with-3-8-drive-tang-11>: HTTP status code is not handled or not allowed
2026-01-10 17:42:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-125strha120a-125-high-output-strobe-amber-120vac>: HTTP status code is not handled or not allowed
2026-01-10 17:42:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-coated-urethane-foam-tape-4016-3-4-x-15-yds-3-mil-off-white>: HTTP status code is not handled or not allowed
2026-01-10 17:42:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyester-tape-8991-2-x-72-yds-2-4-mil-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:42:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-and-3-8-drive-sae-metric-mechanics-tool-set-of-121-pieces>: HTTP status code is not handled or not allowed
2026-01-10 17:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/hand_tools_1/pliers/tongue_groove_pliers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:42:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chalk-refill-2-5-lbs-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:42:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp4100t-5-15-hp-1180-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rug-ram-carpet-pole-carriage-mounted-144-l-1>: HTTP status code is not handled or not allowed
2026-01-10 17:42:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/resettable-drop-n-tell-25g-range-electronic-equipment>: HTTP status code is not handled or not allowed
2026-01-10 17:42:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laptop-backpack-locker-54w-x-18d-x-78h-3-tier-3-wide-711-platinum-assembled>: HTTP status code is not handled or not allowed
2026-01-10 17:42:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/direct-drive-motor-3-4-hp-1075-rpm-208-230v-oao-48y-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:42:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/condenser-fans-motor-1-3-hp-825-rpm-208-230v-teao-48-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:42:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-and-blower-4-57-hp-1550-rpm-115v-teao>: HTTP status code is not handled or not allowed
2026-01-10 17:42:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-log-book-for-propane-counterbalance-forklift-log-986884>: HTTP status code is not handled or not allowed
2026-01-10 17:42:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp4104t-5-30-hp-1770-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/direct-drive-motor-1-6-hp-1050-rpm-115v-oao>: HTTP status code is not handled or not allowed
2026-01-10 17:42:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-three-phase-odp-motor-1-1-2-hp-1725-rpm-230-460v-odp-56h-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:42:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extruded-bumper-no-holes-4-25-w-x-120-l-x-4-h>: HTTP status code is not handled or not allowed
2026-01-10 17:42:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-gaylord-pallet-container-with-lid-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:42:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cewdm3555t-2-hp-3490-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ensorb-super-absorbent-1-gallon-jug-dispenser>: HTTP status code is not handled or not allowed
2026-01-10 17:42:37 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/hand_tools_1/pliers/tongue_groove_pliers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/hand_tools_1/pliers/tongue_groove_pliers landed on page that is not a product page.
2026-01-10 17:42:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-plus-photo-paper-5in-x-7in-white-60-sheets-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/paper_stationery/photo_presentation_paper already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:42:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/charging-hose-hav-60-red-hose>: HTTP status code is not handled or not allowed
2026-01-10 17:42:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-and-blower-1-hp-1725-rpm-115-208-230v-odp-56z-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:42:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cem2333t-5-15-hp-1765-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-straight-male-3-8-tube-x-1-4-nptf-1-1-3-l>: HTTP status code is not handled or not allowed
2026-01-10 17:42:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cem4316t-75-hp-1780-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-union-5mm-tube-1-2-7-l>: HTTP status code is not handled or not allowed
2026-01-10 17:42:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-ventilated-industrial-cabinet-48-w-x-24-d-x-75-h-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:42:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peakworks-csk360-confined-space-kit--tripod-3way-60l-srl-65l-man-winch-bag>: HTTP status code is not handled or not allowed
2026-01-10 17:42:48 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/paper_stationery/photo_presentation_paper> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/paper_stationery/photo_presentation_paper landed on page that is not a product page.
2026-01-10 17:42:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-ventilated-industrial-cabinet-48-w-x-24-d-x-75-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:42:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cecp84104t-5-30-hp-1765-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:42:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/men-wrnkl-resist-ctn-wrk-shirt-shrt-slv-l-dark-navy-sc40-sc40dnssl>: HTTP status code is not handled or not allowed
2026-01-10 17:42:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-tire-storage-shelving-60-inch-w-x-21-inch-d-x-120-inch-h-4-levels-starter-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:42:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-size-stacking-bin-11x23-7-8x10-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:42:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-4-tier-add-on-unit-30-w-x-24-d-x-63-h>: HTTP status code is not handled or not allowed
2026-01-10 17:42:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-cabinet-with-6-drawers-48-w-x-24-d-x-75-h-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:42:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-with-keyless-entry-lock-36-w-x-24-d-x-75-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:42:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-with-electronic-lock-and-card-reader-36-w-x-24-d-x-75-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:42:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-elbow-extended-8mm-tube-x-1-8-ml-bspp-8-9-l>: HTTP status code is not handled or not allowed
2026-01-10 17:42:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oem-replacement-motor-2-67-hp-1500-rpm-115v-teao>: HTTP status code is not handled or not allowed
2026-01-10 17:42:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-heavyweight-cleer-adheer-luggage-tag-with-straps-10-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:43:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-1-4-aro-plug-x-3-8-barb-1-1-2-l>: HTTP status code is not handled or not allowed
2026-01-10 17:43:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-with-keyless-entry-lock-48-w-x-24-d-x-75-h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:43:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-3-8-basic-ind-plug-x-3-8-female-nptf-1-1-3-l>: HTTP status code is not handled or not allowed
2026-01-10 17:43:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-uniform-cabinet-with-7-drawers-48-w-x-24-d-x-75-h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:43:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-elbow-1-8-tube-x-1-8-swift-fit-universal-thread-2-3-l>: HTTP status code is not handled or not allowed
2026-01-10 17:43:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-cabinet-with-6-drawers-48-w-x-24-d-x-75-h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:43:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-jm3112-3-4-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-with-electronic-lock-and-card-reader-60-w-x-24-d-x-75-h-red>: HTTP status code is not handled or not allowed
2026-01-10 17:43:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v-grip-wire-shelving-spill-tray-36-l-x-18-w-x-2-1-4-d-5-gallon-capacity-textured-putty>: HTTP status code is not handled or not allowed
2026-01-10 17:43:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m1019-75-33-hp-1725-1140-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-jpl1510t-7-5-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-idm4115t-50te-hp-3900-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4042 pages (at 101 pages/min), scraped 1699 items (at 37 items/min)
2026-01-10 17:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/outdoor_tools_power_equipment/leaf_blowers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:43:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-l1200-17-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-30-mobile-security-cabinet-bench-esd-safety-edge-1>: HTTP status code is not handled or not allowed
2026-01-10 17:43:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m1706t-2-1-hp-1725-850-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rivetwell-ez-deck-decking-42-inch-w-x-24-inch-d-x-3-4-inch-h-for-use-w-double-rivets>: HTTP status code is not handled or not allowed
2026-01-10 17:43:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mri-safe-howard-instrument-table-24-l-x-36-w-x-34-h-on-casters-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:43:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-run-tee-1-8-tube-x-1-8-ml-2-3-l>: HTTP status code is not handled or not allowed
2026-01-10 17:43:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-branch-tee-1-4-tube-x-1-8-nptf-1-2-3-l>: HTTP status code is not handled or not allowed
2026-01-10 17:43:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bassinet-kit-with-open-shelves-includes-bassinet-basket-w-cardholder-and-mattress-pad>: HTTP status code is not handled or not allowed
2026-01-10 17:43:20 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/outdoor_tools_power_equipment/leaf_blowers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/outdoor_tools_power_equipment/leaf_blowers landed on page that is not a product page.
2026-01-10 17:43:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-deck-for-rivetwell-60-inch-w-x-48-inch-d-x-1-4-inch-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:43:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-em2552t-4-75-hp-1185-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-x-3-reflective-reboundable-delineator-round-white>: HTTP status code is not handled or not allowed
2026-01-10 17:43:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/28-grabber-reflective-delineator-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:43:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-report-covers-with-binding-bars-economy-clear-white-bars-11-x-8-1-2-50-bx>: HTTP status code is not handled or not allowed
2026-01-10 17:43:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-floor-pads-red-16>: HTTP status code is not handled or not allowed
2026-01-10 17:43:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-em4102t-20-hp-1180-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/basket-for-ep30h-s30h-p30h>: HTTP status code is not handled or not allowed
2026-01-10 17:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:43:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-tear-drop-pallet-rack-starter-120-w-x-48-d-x-120-h-b2282508n>: HTTP status code is not handled or not allowed
2026-01-10 17:43:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jbos-5-benchtop-oscillating-spindle-sander-1-2hp-1ph-115v>: HTTP status code is not handled or not allowed
2026-01-10 17:43:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-tear-drop-pallet-rack-add-on-108-w-x-48-d-x-120-h-b2282524n>: HTTP status code is not handled or not allowed
2026-01-10 17:43:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-tear-drop-pallet-rack-starter-96-w-x-36-d-x-96-h-796564n>: HTTP status code is not handled or not allowed
2026-01-10 17:43:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hazardous-waste-vinyl-label-non-hazardous-waste-6-inches-by-6-inches-green-white-50pack-121159>: HTTP status code is not handled or not allowed
2026-01-10 17:43:36 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits landed on page that is not a product page.
2026-01-10 17:43:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-l3705-3-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-needle-valve-knob-adjustment-4mm-tube-x-m5-swift-fit-universal-thread-3-4-l>: HTTP status code is not handled or not allowed
2026-01-10 17:43:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/angular-instrument-table-72-l-x-18-w-x-34-h-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:43:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits>: HTTP status code is not handled or not allowed
2026-01-10 17:43:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m1556t-2-5-hp-1725-850-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sloped-flow-shelving-additional-level-36-x18-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:43:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-flow-control-valve-flow-screw-adjustment-1-8-tube-x-10-32-universal-thread-1-l>: HTTP status code is not handled or not allowed
2026-01-10 17:43:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bmp21-series-nylon-cloth-wire-cable-labels-1-2-w-x-16-l-black-white-m21-500-499>: HTTP status code is not handled or not allowed
2026-01-10 17:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/safety_lockout_identification_tags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:43:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/superfoam-antifatigue-mat-3-x4-5-8-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 17:43:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-needle-valve-screw-adjustment-8mm-tube-x-1-4-swift-fit-universal-thread-1-l>: HTTP status code is not handled or not allowed
2026-01-10 17:43:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-em3664t-2-hp-1165-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterhog-eco-elite-4-wide-5-up-to-60-grey-ash>: HTTP status code is not handled or not allowed
2026-01-10 17:43:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-recycled-plastic-box-truck-8-bushel-500-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/safety_labels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:43:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlake-mecalux-pallet-rack-tear-drop-starter-120-w-x-36-d-x-120-h>: HTTP status code is not handled or not allowed
2026-01-10 17:43:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-step-ladder-stock-picker-cart-2-flat-shelves-986915>: HTTP status code is not handled or not allowed
2026-01-10 17:43:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/easy-access-slant-shelf-chrome-wire-cart-with-8-blue-grid-containers-48-l-x-18-w-x-48-h>: HTTP status code is not handled or not allowed
2026-01-10 17:43:54 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/safety_lockout_identification_tags> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/safety_lockout_identification_tags landed on page that is not a product page.
2026-01-10 17:43:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m73-bracket-tape-dispenser>: HTTP status code is not handled or not allowed
2026-01-10 17:43:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-shipping-tag-4-3-4-x-2-3-8-red-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:43:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g2-pvc-overshoe-size-xl-17-h-cleated-outsole-black-with-black-sole>: HTTP status code is not handled or not allowed
2026-01-10 17:43:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp844256t-4-250-hp-1190-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:43:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/consecutively-numbered-repair-tags-4-3-4-x-2-3-8-yellow-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:44:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-buckle-ice-traction-12-overshoe-mens-sz-11-waterproof-vulcanized-rubber-blk>: HTTP status code is not handled or not allowed
2026-01-10 17:44:00 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/safety_labels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/safety_labels landed on page that is not a product page.
2026-01-10 17:44:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-gas-heater-infrared-positive-pressure-straight-tube-150000-btu-60l>: HTTP status code is not handled or not allowed
2026-01-10 17:44:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/consecutively-numbered-repair-tags-6-1-4-x-3-1-8-red-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:44:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/big-d-carpet-deodorant-powder-breeze-50-lb-container>: HTTP status code is not handled or not allowed
2026-01-10 17:44:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-breathable-jacket-size-men-s-3xl-attached-hood-black>: HTTP status code is not handled or not allowed
2026-01-10 17:44:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-series-perform-02-thirst-quencher-lemon-lime-12-oz-bottle-24-carton>: HTTP status code is not handled or not allowed
2026-01-10 17:44:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-gas-heater-infrared-positive-pressure-u-tube-tough-guy-200000-btu-70l>: HTTP status code is not handled or not allowed
2026-01-10 17:44:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4in-clear-surface-rectangular-mount-ultra-thin-strobe-light-with-3-led-8892231>: HTTP status code is not handled or not allowed
2026-01-10 17:44:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blue-corner-strobe-d-fuser-with-6-led-3024638>: HTTP status code is not handled or not allowed
2026-01-10 17:44:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-static-bag-clear-3-x-5-35mm-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:44:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-safe-utility-lid-light-green>: HTTP status code is not handled or not allowed
2026-01-10 17:44:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4134 pages (at 92 pages/min), scraped 1734 items (at 35 items/min)
2026-01-10 17:44:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-em2394t-15-hp-3520-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:44:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pressure-sensitive-pipe-marker-natural-gas-1>: HTTP status code is not handled or not allowed
2026-01-10 17:44:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s19-2350p-thermostatic-valve-safety-73-gpm>: HTTP status code is not handled or not allowed
2026-01-10 17:44:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-2-premium-pullover-hi-visibility-t-shirt-lime-polyester-sm>: HTTP status code is not handled or not allowed
2026-01-10 17:44:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r-12r-134a-valve-core-repair-kit-msc91337>: HTTP status code is not handled or not allowed
2026-01-10 17:44:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/intellisense-adult-defibrillation-pads-powerheart-g-5-replacing-xela-e-d001a>: HTTP status code is not handled or not allowed
2026-01-10 17:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/medical_devices_instruments/defibrillator_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:44:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jacket-size-men-s-medium-polyester-quilted-liner-attached-hood-black>: HTTP status code is not handled or not allowed
2026-01-10 17:44:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precoiled-strap-on-pipe-marker-oxygen-9>: HTTP status code is not handled or not allowed
2026-01-10 17:44:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4in-clear-round-backup-light-with-10-led-5624350>: HTTP status code is not handled or not allowed
2026-01-10 17:44:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-r-class-3-pullover-hoodie-polyester-lime-4xl>: HTTP status code is not handled or not allowed
2026-01-10 17:44:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/400-coverall-zipper-front-hood-elastic-wrist-ankle-stormflap-white-md>: HTTP status code is not handled or not allowed
2026-01-10 17:44:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jack-stands-2-ton-pair-kti61201>: HTTP status code is not handled or not allowed
2026-01-10 17:44:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hemco-scofflaw-fume-hood-48-x-23-x-36>: HTTP status code is not handled or not allowed
2026-01-10 17:44:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-air-mover-adapter-641770>: HTTP status code is not handled or not allowed
2026-01-10 17:44:27 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/medical_devices_instruments/defibrillator_accessories> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/medical_devices_instruments/defibrillator_accessories landed on page that is not a product page.
2026-01-10 17:44:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hemco-ductless-demonstration-hood-35-x-24-x-30>: HTTP status code is not handled or not allowed
2026-01-10 17:44:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-x-092-ring-shank-15-degree-coil-siding-nails-galvanized-3600-qty>: HTTP status code is not handled or not allowed
2026-01-10 17:44:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tennant-v-bp-6-backpack-replacement-vacuum-bags>: HTTP status code is not handled or not allowed
2026-01-10 17:44:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-to-3-1-4-28-degree-wire-weld-framing-nailer>: HTTP status code is not handled or not allowed
2026-01-10 17:44:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vbm3538-5s-5-hp-1750-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/air_tools_accessories/air_nailers_staplers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:44:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/101w-wd-hanger-stacker-metal-wh-pkg-qty-1>: HTTP status code is not handled or not allowed
2026-01-10 17:44:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precoiled-strap-on-pipe-marker-air-5>: HTTP status code is not handled or not allowed
2026-01-10 17:44:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ucl345-3-4-5airover-hp-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:44:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mlrs15mclk-breast-milk-refrigerator-with-8-lockers-15-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 17:44:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coil-siding-nail-316-stainless-steel-1-3-4-x-090-ring-4200-qty>: HTTP status code is not handled or not allowed
2026-01-10 17:44:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acoustic-room-dividers-three-pack-misty-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:44:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-gauge-2-l-shape-flooring-cleats-1000-qty>: HTTP status code is not handled or not allowed
2026-01-10 17:44:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/privacy-screen-designer-cloth-screen-panel-lavender>: HTTP status code is not handled or not allowed
2026-01-10 17:44:43 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/air_tools_accessories/air_nailers_staplers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/air_tools_accessories/air_nailers_staplers landed on page that is not a product page.
2026-01-10 17:44:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iron-horse-3800lb-concealed-riveted-shelving-5-shelf-84-h-x-48-w-x-24-d-black>: HTTP status code is not handled or not allowed
2026-01-10 17:44:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48l-rectangle-plastic-height-adjustable-activity-table-set-with-6-chairs-green>: HTTP status code is not handled or not allowed
2026-01-10 17:44:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-weather-faux-rattan-chair-light-gray-with-light-gray-cushion>: HTTP status code is not handled or not allowed
2026-01-10 17:44:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orbis-lid-folding-bulk-shipping-container-32x30>: HTTP status code is not handled or not allowed
2026-01-10 17:44:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vebm3558-2-hp-1755-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:44:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-x-close-welded-pipe-nipple-schedule-40-304-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:44:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-channel-industrial-cable-protector-channel-22000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:44:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-vinyl-sign-danger-chemical-storage-area-authorized-personnel-only-2>: HTTP status code is not handled or not allowed
2026-01-10 17:44:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vefwdm3546t-1-hp-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:44:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kneespace-credenza-72-inch-w-x-24-inch-d-x-29-half-inch-h-silver-mesh-and-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:44:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-grain-goatskin-leather-protector-for-novax-gloves-white-size-10>: HTTP status code is not handled or not allowed
2026-01-10 17:44:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-economy-lever-hoist-3-ton-capacity-20-lift>: HTTP status code is not handled or not allowed
2026-01-10 17:44:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lever-hoist-with-overload-protection-1-1-2-ton-capacity-20-lift>: HTTP status code is not handled or not allowed
2026-01-10 17:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/furniture_parts_accessories/partition_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:44:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protective-bag-for-novax-rubber-insulating-gloves-14-l-black-one-size>: HTTP status code is not handled or not allowed
2026-01-10 17:45:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carbon-steel-hand-winch-with-brake-1500-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:45:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spanish-plastic-sign-peligro-alto-voltaje-mantengase-afuera>: HTTP status code is not handled or not allowed
2026-01-10 17:45:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torx-174-align-25-insert-bit-x-1-s2-modified-steel-gunmetal-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/outdoor_structures_storage/canopies_carports_utility_tents/utility_work_tents already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:45:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-3mm-power-bit-x-3-1-2-s2-modified-steel-gunmetal-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:45:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-vinyl-sign-danger-hard-hats-required-this-area>: HTTP status code is not handled or not allowed
2026-01-10 17:45:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vwdl3514-1-5-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:45:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-3-fr-long-sleeve-t-shirt-fluorescent-yellow-green-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:45:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10x42mm-full-sized-waterproof-binoculars>: HTTP status code is not handled or not allowed
2026-01-10 17:45:08 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/furniture_parts_accessories/partition_accessories> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/furniture_parts_accessories/partition_accessories landed on page that is not a product page.
2026-01-10 17:45:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vwdm3542-5-75-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:45:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4229 pages (at 95 pages/min), scraped 1776 items (at 42 items/min)
2026-01-10 17:45:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-3-tier-wire-shelving-add-on-unit-36w-x-21d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ada-compliant-built-in-undercounter-refrigerator-auto-defrost-front-lock-and-white-exterior>: HTTP status code is not handled or not allowed
2026-01-10 17:45:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/outdoor_structures_storage/canopies_carports_utility_tents/utility_work_tents>: HTTP status code is not handled or not allowed
2026-01-10 17:45:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torx-174-30-insert-bit-x-1-gunmetal-bronze-s2-modified-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:45:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/little-giant-wwc2-3072-heavy-duty-cabinet-workbench-steel-top-center-shelf>: HTTP status code is not handled or not allowed
2026-01-10 17:45:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-10-t-slot-nut-13-16-table-slot-1-3-8-base-width-1-3-8-height-carbon-steel-black-oxide-tn-40>: HTTP status code is not handled or not allowed
2026-01-10 17:45:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-foot-patio-umbrella-olefin-hunter-green-silver-pole-venture>: HTTP status code is not handled or not allowed
2026-01-10 17:45:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protecta-1161521-vest-style-climbing-harness-back-and-front-d-rings-m-l>: HTTP status code is not handled or not allowed
2026-01-10 17:45:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wsl2-3072-ah-welded-steel-workbenches-w-back-and-end-stops-30-x-72-adj-height>: HTTP status code is not handled or not allowed
2026-01-10 17:45:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-2-tier-wire-shelving-add-on-unit-72w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-plastic-sign-notice-keep-this-door-closed-2>: HTTP status code is not handled or not allowed
2026-01-10 17:45:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-2-tier-wire-shelving-starter-unit-54w-x-21d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-2-tier-wire-shelving-starter-unit-24w-x-14d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cam-follower-sealed-hex-head-3-1-2-l-stud-225-w-roller-4-roller-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:45:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-battery-cable-with-3-8-ring-terminals-4-awg-1-ft-black>: HTTP status code is not handled or not allowed
2026-01-10 17:45:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-174-manual-dispenser-foam-hand-soap-sanitizer-black>: HTTP status code is not handled or not allowed
2026-01-10 17:45:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sk2000-boltless-pallet-rack-48-inch-x-96-inch-upright-frame>: HTTP status code is not handled or not allowed
2026-01-10 17:45:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rcb-25-rebar-cutter-bender-5-8-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:45:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sk2000-boltless-pallet-rack-5-inch-x-96-inch-step-beam>: HTTP status code is not handled or not allowed
2026-01-10 17:45:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-battery-cable-with-5-16-ring-terminals-2-awg-3-ft-red>: HTTP status code is not handled or not allowed
2026-01-10 17:45:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sk2000-boltless-pallet-rack-8-inch-wall-ties>: HTTP status code is not handled or not allowed
2026-01-10 17:45:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-truck-esd-18w-x-48l-x-60h-polyurethane-4-swivel-2-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 17:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/plumbing/sinks/wash_fountains already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:45:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sn2023-sentry-3-person-semi-circular-bowl-washfountain-w-central-vent-metering-air-valve>: HTTP status code is not handled or not allowed
2026-01-10 17:45:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/divided-quad-glove-box-dispenser-5-5-8-w-x-3-13-16-d-x-9-15-16-h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:45:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/danger-sign-14x10-rigid-plastic-cylinders-must-be-secured>: HTTP status code is not handled or not allowed
2026-01-10 17:45:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/danger-sign-14x10-vinyl-ear-protection-required>: HTTP status code is not handled or not allowed
2026-01-10 17:45:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs>: HTTP status code is not handled or not allowed
2026-01-10 17:45:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-esd-30w-x-60l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oty-78034-4-pvc-roof-drain-with-abs-dome-and-dam-collar>: HTTP status code is not handled or not allowed
2026-01-10 17:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:45:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protective-wear-organizer-22-5-16-w-x-3-13-16-d-x-10-h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/plumbing/sinks/wash_fountains>: HTTP status code is not handled or not allowed
2026-01-10 17:45:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phaseii-pht-980-shore-d-durometer>: HTTP status code is not handled or not allowed
2026-01-10 17:45:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honeywell-thermostat-tradeline-with-thermometer>: HTTP status code is not handled or not allowed
2026-01-10 17:45:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4x15x4-1-2-open-top-bin-boxes>: HTTP status code is not handled or not allowed
2026-01-10 17:45:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10666-surf-cond-belt-ls-fd-48-x-6-aluminum-oxide-very-fine>: HTTP status code is not handled or not allowed
2026-01-10 17:45:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-2-tier-esd-18w-x-36l-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-esd-24w-x-30l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:54 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs landed on page that is not a product page.
2026-01-10 17:45:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cable-splicers-knife-6-1-4-inch-with-leather-belt-pouch>: HTTP status code is not handled or not allowed
2026-01-10 17:45:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-esd-21w-x-60l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-esd-36w-x-60l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 17:45:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-office-partition-panel-24-14-w-x-96-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:46:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cloth-belt-82574-1-2-24-60-grit-ceramic>: HTTP status code is not handled or not allowed
2026-01-10 17:46:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foam-side-rail-bumper-pads-36l-x-14w-x-1-12h>: HTTP status code is not handled or not allowed
2026-01-10 17:46:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/goffs-welding-screen-6w-x-8h-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:46:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-3-tier-esd-18w-x-60l-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 17:46:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-plastic-garbage-can-with-lid-44-gal-green>: HTTP status code is not handled or not allowed
2026-01-10 17:46:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyurethane-tubing-for-drinking-water-18id-x-14od-x-25-ft>: HTTP status code is not handled or not allowed
2026-01-10 17:46:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-high-performance-v2100-rust-preventive-enamel-aero-gloss-wh>: HTTP status code is not handled or not allowed
2026-01-10 17:46:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fda-buna-n-sanitary-gasket-for-15-tube>: HTTP status code is not handled or not allowed
2026-01-10 17:46:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-partition-panel-with-partial-window-raceway-60-14-w-x-64-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:46:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4324 pages (at 95 pages/min), scraped 1820 items (at 44 items/min)
2026-01-10 17:46:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-28-x-military-pan-head-machine-screws-MS51958-82>: HTTP status code is not handled or not allowed
2026-01-10 17:46:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-office-partition-panel-wpartial-window-48-14-w-x-73-12-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:46:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clean-room-fda-viton-sanitary-gasket-for-4-tube>: HTTP status code is not handled or not allowed
2026-01-10 17:46:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-shot-5500w-portable-generator-black>: HTTP status code is not handled or not allowed
2026-01-10 17:46:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-36w-x-72l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:46:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-sierra-perform-beyond-0-voc-acrylic-enamel-gloss-safety-red>: HTTP status code is not handled or not allowed
2026-01-10 17:46:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-link-t-link-hard-hat-tychem-2000-hood-hx5-backpack-papr>: HTTP status code is not handled or not allowed
2026-01-10 17:46:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brown-viton-o-ring-dash-026-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 17:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/paper_stationery/index_cards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:46:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-18w-x-24l-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 17:46:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-24x1-indented-hex-head-machine-screws-1016MH188>: HTTP status code is not handled or not allowed
2026-01-10 17:46:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-office-partition-panel-48-14-w-x-43-12-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:46:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-21w-x-36l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 17:46:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x1-2-modified-truss-head-self-drilling-screws-0808KPMB>: HTTP status code is not handled or not allowed
2026-01-10 17:46:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-office-partition-panel-with-partial-window-36-14-w-x-75-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:46:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-safety-sign-fire-hose-plastic-3>: HTTP status code is not handled or not allowed
2026-01-10 17:46:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-panel-hinged-shipping-crate-with-lid-24-x-24-x-24-od>: HTTP status code is not handled or not allowed
2026-01-10 17:46:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/paper_stationery/index_cards>: HTTP status code is not handled or not allowed
2026-01-10 17:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/beds_mattresses/mattresses already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:46:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-o-ring-1mm-wide-28mm-id-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 17:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery/metal_cutting_forming_machines/combination_metalworking_machines already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:46:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20-serrated-flange-lock-nuts-14NRB>: HTTP status code is not handled or not allowed
2026-01-10 17:46:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-valve-lockout-3>: HTTP status code is not handled or not allowed
2026-01-10 17:46:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laminated-lockout-tags-1>: HTTP status code is not handled or not allowed
2026-01-10 17:46:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10x1-2-8hd-pan-head-high-low-screws-1008HTP>: HTTP status code is not handled or not allowed
2026-01-10 17:46:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/riverdale-twin-size-tufted-upholstered-platform-bed-in-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:46:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rm40-p-industrial-dehumidifier>: HTTP status code is not handled or not allowed
2026-01-10 17:46:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sustain-landfill-container-23-gal-black>: HTTP status code is not handled or not allowed
2026-01-10 17:46:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/beds_mattresses/mattresses>: HTTP status code is not handled or not allowed
2026-01-10 17:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/beds_mattresses/mattresses already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:46:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/machining/machinery/metal_cutting_forming_machines/combination_metalworking_machines>: HTTP status code is not handled or not allowed
2026-01-10 17:46:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/55-33-16-5-ton-air-hydraulic-truck-jack-6855>: HTTP status code is not handled or not allowed
2026-01-10 17:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/beds_mattresses/beds_headboards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:46:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x1-1-2-flat-self-drilling-screws-0824KQF>: HTTP status code is not handled or not allowed
2026-01-10 17:46:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/detectable-underground-warning-tape-caution-buried-sewer-line-below-3-w>: HTTP status code is not handled or not allowed
2026-01-10 17:46:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-12-install-kit-5-hp>: HTTP status code is not handled or not allowed
2026-01-10 17:46:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-25-11110-400-psi-14-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 17:46:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dp200-36-round-traffic-channelizer-post-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:46:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-fuel-ventless-gas-fireplace-w-mantel-32000-btu-t-stat-control-toasted-almond>: HTTP status code is not handled or not allowed
2026-01-10 17:46:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premier-stainless-steel-solid-door-laboratory-freezer-49-cu-ft-abt-hc-ssp-49fa>: HTTP status code is not handled or not allowed
2026-01-10 17:46:50 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/beds_mattresses/mattresses> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/beds_mattresses/mattresses landed on page that is not a product page.
2026-01-10 17:46:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/professional-numberer-self-inking-type-size-1-1-2-six-digits-black>: HTTP status code is not handled or not allowed
2026-01-10 17:46:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/beds_mattresses/beds_headboards>: HTTP status code is not handled or not allowed
2026-01-10 17:46:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-shelving-unit-36-wx18-dx86-h-solid-shelf>: HTTP status code is not handled or not allowed
2026-01-10 17:46:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-ink-pad-for-printer-p50-black>: HTTP status code is not handled or not allowed
2026-01-10 17:46:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-fuel-ventless-gas-stove-23000-btu-t-stat-control>: HTTP status code is not handled or not allowed
2026-01-10 17:46:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lux-sspp2b-oxl-ss-wick-b-eye-polo-org-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:46:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-2-11110-30-psi-18-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 17:46:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-45-11125ct-100-psi-14-lm-ss>: HTTP status code is not handled or not allowed
2026-01-10 17:47:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neoprene-foam-with-acrylic-adhesive-316-thick-x-516w-x-10l>: HTTP status code is not handled or not allowed
2026-01-10 17:47:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-2-11112-160-psikgcm2-14-cbm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 17:47:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-8-heavy-hex-nuts-100A563DH>: HTTP status code is not handled or not allowed
2026-01-10 17:47:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-2-11110-100-psi-14-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 17:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/anchors_hangers/wall_anchors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:47:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triple-view-weekly-monthly-appointment-book-black-8-1-4-x-10-7-8-2015-aag70950v05>: HTTP status code is not handled or not allowed
2026-01-10 17:47:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h19r-core-rechargeable-led-headlamp>: HTTP status code is not handled or not allowed
2026-01-10 17:47:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-40x9-16-hex-standoffs-140904HFN>: HTTP status code is not handled or not allowed
2026-01-10 17:47:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-sign-rigid-plastic-le-arrow>: HTTP status code is not handled or not allowed
2026-01-10 17:47:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4415 pages (at 91 pages/min), scraped 1859 items (at 39 items/min)
2026-01-10 17:47:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-42-office-partition-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:47:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-sign-vinyl-fire-equipment>: HTTP status code is not handled or not allowed
2026-01-10 17:47:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-liter-desk-style-highlighters-chisel-tip-assorted-colors-dozen>: HTTP status code is not handled or not allowed
2026-01-10 17:47:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protect-all-surface-protectant-1-gallon-4-bottle>: HTTP status code is not handled or not allowed
2026-01-10 17:47:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/fasteners/anchors_hangers/wall_anchors>: HTTP status code is not handled or not allowed
2026-01-10 17:47:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/finito-stick-porous-point-pen-extra-fine-0-4mm-blue-ink-blue-silver-barrel-dozen>: HTTP status code is not handled or not allowed
2026-01-10 17:47:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/easy-peel-inkjet-address-labels-1-1-3-x-4-white-350-pack-8162>: HTTP status code is not handled or not allowed
2026-01-10 17:47:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16x2-3-4-wedge-anchor-icc-compliant-icbo-3144AWG>: HTTP status code is not handled or not allowed
2026-01-10 17:47:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kodiak-animal-resistant-waste-receptacle-63-w-x-27-d-x-33-h-grey>: HTTP status code is not handled or not allowed
2026-01-10 17:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:47:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/csx3000-power-commercial-series-top-handle-chainsaw-w-battery-holster>: HTTP status code is not handled or not allowed
2026-01-10 17:47:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-labels-with-trueblock-technology-8-1-2-x-11-white-ink-jet-25-pack-8165>: HTTP status code is not handled or not allowed
2026-01-10 17:47:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-sign-vinyl-fire-exit>: HTTP status code is not handled or not allowed
2026-01-10 17:47:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-four-drawer-procedure-cart-with-pushbutton-e-lock-purple>: HTTP status code is not handled or not allowed
2026-01-10 17:47:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/easy-peel-inkjet-mailing-labels-1-x-2-5-8-clear-300-pack-18660>: HTTP status code is not handled or not allowed
2026-01-10 17:47:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/odorstop-72-watt-uv-air-treatment-system-with-airflow-sensor-and-16-bulbs>: HTTP status code is not handled or not allowed
2026-01-10 17:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:47:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bishamon-foot-operated-high-li-skid-truck-2200-lb-cap-27-x-42-5-forks>: HTTP status code is not handled or not allowed
2026-01-10 17:47:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-six-drawer-anesthesia-cart-with-md30-ans3-accessory-package-purple>: HTTP status code is not handled or not allowed
2026-01-10 17:47:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs>: HTTP status code is not handled or not allowed
2026-01-10 17:47:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-8-plastic-anchors-08PA>: HTTP status code is not handled or not allowed
2026-01-10 17:47:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-pocket-verticle-literature-rack-black>: HTTP status code is not handled or not allowed
2026-01-10 17:47:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-drawer-cabinet-64-drawers>: HTTP status code is not handled or not allowed
2026-01-10 17:47:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-dia-x-9-working-length-j-hook-style-a>: HTTP status code is not handled or not allowed
2026-01-10 17:47:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/first-aid-box-polystyrene-9-3-16x2-3-4x6-1-2>: HTTP status code is not handled or not allowed
2026-01-10 17:47:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs>: HTTP status code is not handled or not allowed
2026-01-10 17:47:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-visibility-reversible-rain-cap-300d-oxfordpu-coating-orangeblack-one-size>: HTTP status code is not handled or not allowed
2026-01-10 17:47:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-short-emergency-crash-cart-md30-emg1-std-width-4-drawers-breakaway-lock-pink>: HTTP status code is not handled or not allowed
2026-01-10 17:47:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suredry-14-scope-drying-cabinet-w-e-lock-36-w-x-24-d-x-93-h-sand>: HTTP status code is not handled or not allowed
2026-01-10 17:47:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/first-aid-cabinet-3-shelf-15x5-9-16x16-5-32>: HTTP status code is not handled or not allowed
2026-01-10 17:47:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-drawer-aluminum-short-anesthesia-cart-key-lock-dark-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:47:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/weight-driven-grinder-g9wd-rh-120v>: HTTP status code is not handled or not allowed
2026-01-10 17:47:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-drawer-parts-cabinet-10124-20w-x-6-3-8d-x-15-13-16h-black-25-drawers>: HTTP status code is not handled or not allowed
2026-01-10 17:47:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/61331-s762p-non-ansi-vest-tricot-hook-loop-closure-hi-vis-pink-md>: HTTP status code is not handled or not allowed
2026-01-10 17:47:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-placard-non-flammable-gas-2-2>: HTTP status code is not handled or not allowed
2026-01-10 17:47:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-duty-nylon-glove-polyurethane-coated-white-33-125-l>: HTTP status code is not handled or not allowed
2026-01-10 17:47:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-data-and-media-safe-dt200e-electronic-lock-29-1-4w-x-27d-x-87-3-4h-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:47:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-ring-label-hold-binder-1capacity-11x8-1-2-black>: HTTP status code is not handled or not allowed
2026-01-10 17:47:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parking-permit-blue-windshield-001-100>: HTTP status code is not handled or not allowed
2026-01-10 17:47:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-voltage-370-440-oval-run-capacitor-25-mfd-25dv>: HTTP status code is not handled or not allowed
2026-01-10 17:47:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bronchoscope-drying-cabinet-wall-mount-key-lock-24-w-x-12-3-4-d-x-48-h-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:47:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n-ferno-6466-thermal-jacket-black-3xl-41117>: HTTP status code is not handled or not allowed
2026-01-10 17:47:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8377-type-r-class-3-quilted-bomber-jacket-orange-l-25614>: HTTP status code is not handled or not allowed
2026-01-10 17:47:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s373pt-ansi-class-e-lightweight-rain-pants-hi-vis-lime-lg-61511>: HTTP status code is not handled or not allowed
2026-01-10 17:47:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz-skoll-safety-glasses-clear-lens-black-frame-59003>: HTTP status code is not handled or not allowed
2026-01-10 17:47:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-816-thermal-flip-top-gloves-black-2xl-17346>: HTTP status code is not handled or not allowed
2026-01-10 17:47:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-placard-1866-3-2>: HTTP status code is not handled or not allowed
2026-01-10 17:47:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-series-lt-weight-emergency-cart-6-drawers-key-lock-36-3-4-wx22-lx40-1-2-h-hammertone-green>: HTTP status code is not handled or not allowed
2026-01-10 17:47:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s268-mesh-neck-shield-hi-vis-lime-one-size-3-pack-19282>: HTTP status code is not handled or not allowed
2026-01-10 17:48:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swf20-114-id-round-flange-type-linear-bearing-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:48:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-placard-flammable-gas-2-3>: HTTP status code is not handled or not allowed
2026-01-10 17:48:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-placard-flammable-3-blank-2>: HTTP status code is not handled or not allowed
2026-01-10 17:48:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-column-medical-storage-cart-glass-door-22-1-2-w-x-27-d-x-75-3-4-h-light-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:48:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-column-medical-storage-cart-glass-door-22-1-2-w-x-27-d-x-75-3-4-h-cream>: HTTP status code is not handled or not allowed
2026-01-10 17:48:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6015-open-75mm-bore-115mm-od>: HTTP status code is not handled or not allowed
2026-01-10 17:48:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-green-wire-shelf-platform-p1830g-30w-x-18d>: HTTP status code is not handled or not allowed
2026-01-10 17:48:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-72-economy-h-beam-adjustable-length-yellow-102-l-x-40-w-x-36-h-425lbs-4000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:48:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-cart-package-red-danger-high-voltage-keep-out-banner>: HTTP status code is not handled or not allowed
2026-01-10 17:48:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/307021-stainless-steel-single-bulk-ppe-dispenser-6-w-x-5-3-4-d-x-17-h>: HTTP status code is not handled or not allowed
2026-01-10 17:48:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-2-shelf-container-rack-bk186052n-60w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 17:48:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4512 pages (at 97 pages/min), scraped 1898 items (at 39 items/min)
2026-01-10 17:48:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-spread-basket-lifting-beam-yellow-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/floor_mats/entrance_mats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:48:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tall-savary-dilator-drying-cart-hepa-filter-23-89-100-wx22-lx51-89-100-h-purple>: HTTP status code is not handled or not allowed
2026-01-10 17:48:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-propelled-electric-scale-pallet-truck-scale-pallet-jack-3000-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 17:48:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6011nr-open-wsnap-ring-55mm-bore-90mm-od>: HTTP status code is not handled or not allowed
2026-01-10 17:48:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6011-2rs-double-sealed-55mm-bore-90mm-od>: HTTP status code is not handled or not allowed
2026-01-10 17:48:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbl482412g-lbox-lbox-wall-mount-cab-4800x2400x1200>: HTTP status code is not handled or not allowed
2026-01-10 17:48:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d181610chscfgwp-wifi-cab-type-4x-window-door-1800x1600x1000-fiberglass>: HTTP status code is not handled or not allowed
2026-01-10 17:48:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/un3082-orange-panel-permanent-vinyl-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:48:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flashing-light-led-120-240vac-hazardous-location-red-191xl-120-240r>: HTTP status code is not handled or not allowed
2026-01-10 17:48:21 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/floor_mats/entrance_mats> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/floor_mats/entrance_mats landed on page that is not a product page.
2026-01-10 17:48:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrosive-placard-un-3266-removable-vinyl-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:48:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-series-aluminium-medical-cart-short-height-36-3-4-w-x-22-l-x-37-1-4-h-brushed-silver>: HTTP status code is not handled or not allowed
2026-01-10 17:48:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilco-rl-f-rail-system-for-48x48-roof-hatch>: HTTP status code is not handled or not allowed
2026-01-10 17:48:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/384-well-tissue-culture-plate-with-lid-individual-sterile-50-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:48:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-narrow-procedure-cart-6-drawers-key-lock-18-w-x-18-l-x-40-3-4-h-light-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:48:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-procedure-cart-6-drawers-e-lock-36-3-4-w-x-22-l-x-43-3-4-h-beige>: HTTP status code is not handled or not allowed
2026-01-10 17:48:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-x-1-4-iglide-g300-polymer-sleeve-bearing>: HTTP status code is not handled or not allowed
2026-01-10 17:48:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rip-fence-5782172>: HTTP status code is not handled or not allowed
2026-01-10 17:48:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wash-your-hands-before-leaving-this-room-sticker-adhesive-backed-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 17:48:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35mm-x-10mm-petri-dish-sterile-clear-polystyrene-960-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:48:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cap-insert-for-cf-cryogenic-vials-assorted-colors-non-sterile-polypropylene-500-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:48:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fda-approved-yellow-x-large-tote-47-1-4l-x-51-1-2w-x-33h>: HTTP status code is not handled or not allowed
2026-01-10 17:48:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1161300-construction-style-harness-pass-through-tongue-buckle-s>: HTTP status code is not handled or not allowed
2026-01-10 17:48:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/facility-visi-sign-disabled-access-symbol>: HTTP status code is not handled or not allowed
2026-01-10 17:48:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-emergency-crash-cart-6-drawers-36-3-4-w-x-22-l-x-43-3-4-h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:48:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-series-narrow-medical-cart-6-drawers-e-lock-24-3-4-wx22-lx43-3-4-h-navy>: HTTP status code is not handled or not allowed
2026-01-10 17:48:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1161220-comfort-construction-style-climbing-harness-quick-connect-s>: HTTP status code is not handled or not allowed
2026-01-10 17:48:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-sign-caution-watch-your-step-wet-paint>: HTTP status code is not handled or not allowed
2026-01-10 17:48:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/515-tank-heavy-duty-shipping-case-tube-with-wheels-17l-x-17w-x-77h-blk>: HTTP status code is not handled or not allowed
2026-01-10 17:48:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m6-10-insert-for-soft-wood-flush-800610-13>: HTTP status code is not handled or not allowed
2026-01-10 17:48:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s100x8-female-buttress-x-2-female-npt-pipe-thread>: HTTP status code is not handled or not allowed
2026-01-10 17:48:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-16-carbon-steel-insert-for-metal-329-601>: HTTP status code is not handled or not allowed
2026-01-10 17:48:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1161540-vest-style-positioning-retrieval-harness-pass-through-tongue-buckle-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:48:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/envirosalv-95-gallon-poly-overpack>: HTTP status code is not handled or not allowed
2026-01-10 17:48:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-sign-caution-chemical-spill-keep-out>: HTTP status code is not handled or not allowed
2026-01-10 17:48:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ps-plasteur-174-pasteur-pipet-5-3-4-l-individually-wrapped-sterile-200-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:48:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-height-triple-column-medical-storage-cabinet-60-2-5-wx27-4-5-dx55-3-5-h-mauve>: HTTP status code is not handled or not allowed
2026-01-10 17:48:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wedgebit-drill-bit-sdsplus-size-12-usable-8-l-overall-13-l>: HTTP status code is not handled or not allowed
2026-01-10 17:48:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/softsided-display-panel-case-270-50-1-2l-x-27w-x-7h-royal-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:48:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labor-law-poster-illinois>: HTTP status code is not handled or not allowed
2026-01-10 17:48:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labor-law-poster-maryland>: HTTP status code is not handled or not allowed
2026-01-10 17:48:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/engraved-sign-women-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:48:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-underbody-truck-box-with-3-point-latch-matte-black-24x24x30-1734503>: HTTP status code is not handled or not allowed
2026-01-10 17:48:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15300-dynafile-iii-abrasive-belt-tool-7hp-7-degree-offset-20000-rpm-front-exhaust>: HTTP status code is not handled or not allowed
2026-01-10 17:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:49:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eco-black-ns-precut-intrinsic-anti-spastic-hand-splint-1-8-mini-perforated-small>: HTTP status code is not handled or not allowed
2026-01-10 17:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:49:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-32-reverse-slot-press-insert-brass-260-332-rs>: HTTP status code is not handled or not allowed
2026-01-10 17:49:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ws201608ss-watershedwall-mt-encl-type-4x-2000x1600x800in>: HTTP status code is not handled or not allowed
2026-01-10 17:49:03 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights landed on page that is not a product page.
2026-01-10 17:49:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500hb-handlebar-accessory-for-500-series-scales>: HTTP status code is not handled or not allowed
2026-01-10 17:49:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sw-9040-3-4-bostitch-style-stick-staples>: HTTP status code is not handled or not allowed
2026-01-10 17:49:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thhn-12-gauge-building-wire-stranded-type-black-500-ft>: HTTP status code is not handled or not allowed
2026-01-10 17:49:07 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights landed on page that is not a product page.
2026-01-10 17:49:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/champion-fmpsa2710rc-fmpro-all-stainless-27-wx20-dx66-1-8-h-10-drawer-chest-roller-cabinet-combo>: HTTP status code is not handled or not allowed
2026-01-10 17:49:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-acting-pneumatic-actuator-2906-in-lbs-80psi>: HTTP status code is not handled or not allowed
2026-01-10 17:49:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4605 pages (at 93 pages/min), scraped 1937 items (at 39 items/min)
2026-01-10 17:49:09 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights landed on page that is not a product page.
2026-01-10 17:49:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-return-pneumatic-actuator-1055-in-lbs-spring-end>: HTTP status code is not handled or not allowed
2026-01-10 17:49:11 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/emergency_vehicle_lights landed on page that is not a product page.
2026-01-10 17:49:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-acting-pneumatic-actuator-851-in-lbs-80psi>: HTTP status code is not handled or not allowed
2026-01-10 17:49:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-lad-saf-50-ft-vertical-safety-system-stainless-steel-cable-6119050>: HTTP status code is not handled or not allowed
2026-01-10 17:49:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-bottom-cabinet-frame-for-nexel-model-243006>: HTTP status code is not handled or not allowed
2026-01-10 17:49:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-inch-vertical-charcoal-smoker>: HTTP status code is not handled or not allowed
2026-01-10 17:49:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-wafer-style-butterfly-valve-w-epdm-seals-and-dbl-acting-pneum-actuator>: HTTP status code is not handled or not allowed
2026-01-10 17:49:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-cap-for-cg-30-corner-guard-harvard-gray-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 17:49:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-surface-mounted-corner-guard-90-degrees-corner-3-4-inch-wings-4-ft-h-cappuccino-vinyl-w-tape>: HTTP status code is not handled or not allowed
2026-01-10 17:49:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-55-limit-switch-80-1-gear-ratio-w-2-contact-blocks>: HTTP status code is not handled or not allowed
2026-01-10 17:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:49:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ac4m6st-caster-kit-stationary2-casterskit-3dia>: HTTP status code is not handled or not allowed
2026-01-10 17:49:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fox-earpiece-ep1089sc>: HTTP status code is not handled or not allowed
2026-01-10 17:49:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/weld-on-excavator-hook-8800-lb-load-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:49:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beam-seating-4-navy-seats>: HTTP status code is not handled or not allowed
2026-01-10 17:49:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-key-lock-device-kit>: HTTP status code is not handled or not allowed
2026-01-10 17:49:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-ton-m20-pivot-swivel-load-ring>: HTTP status code is not handled or not allowed
2026-01-10 17:49:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-lock-solid-aluminum-rectangular-padlock-red-no-a1267red>: HTTP status code is not handled or not allowed
2026-01-10 17:49:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-lab-coat-white-polycombed-cotton-tall-44>: HTTP status code is not handled or not allowed
2026-01-10 17:49:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerpoint-hoist-ring-360-pivot-8800-lb-load-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:49:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:49:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-lock-non-rekeyable-solid-steel-padlock-no-a51>: HTTP status code is not handled or not allowed
2026-01-10 17:49:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fork-lift-beam-double-fork-single-swivel-hook-30-000lb>: HTTP status code is not handled or not allowed
2026-01-10 17:49:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-gripper-front-lab-coat-white-polycotton-m>: HTTP status code is not handled or not allowed
2026-01-10 17:49:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-button-front-lab-coat-white-polycotton-m>: HTTP status code is not handled or not allowed
2026-01-10 17:49:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2in-solid-shank-clevis-ball-mount-9-1-4in-long-1803065>: HTTP status code is not handled or not allowed
2026-01-10 17:49:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-grade-100-250-ft-dr-black>: HTTP status code is not handled or not allowed
2026-01-10 17:49:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-button-front-lab-coat-white-polycombed-cotton-xs>: HTTP status code is not handled or not allowed
2026-01-10 17:49:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vertical-pallet-lifter-fixed-fork-3-ton-capacity-42-fork-length-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:49:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-spreader-beam-30-000-lbs-capacity-240-chain-top-rigging-yellow-steel>: HTTP status code is not handled or not allowed
2026-01-10 17:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:49:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-5-16in-heavy-duty-a-frame-black-cast-coupler-0091595>: HTTP status code is not handled or not allowed
2026-01-10 17:49:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2in-receiver-mounted-tow-hook-10-000-lbs-rm10h>: HTTP status code is not handled or not allowed
2026-01-10 17:49:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-332-thick-x-18-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 17:49:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unistrut-1-58-beam-clamp-p3087eg-electro-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 17:49:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-light-13-flush-mount-alabaster-glass-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 17:49:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unistrut-1-58-u-shape-fitting-p1377eg-4-hole>: HTTP status code is not handled or not allowed
2026-01-10 17:49:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-x-19-louver-panel-blue-3>: HTTP status code is not handled or not allowed
2026-01-10 17:49:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unistrut-1-58-x-1-58-metal-framing-channel-p1000t10gr-12-gage-slotted>: HTTP status code is not handled or not allowed
2026-01-10 17:49:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-assembly-for-wpx45-pallet-trucks-cl-1120-133000-10-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:49:50 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:49:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/semi-clear-fda-silicone-rubber-roll-no-adhesive-60a-116-thick-x-36-wide-x-6-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:49:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-long-sleeve-work-shirt-fluorescent-orange-tall-2xl>: HTTP status code is not handled or not allowed
2026-01-10 17:49:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-38-thick-x-8-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:49:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14x36x74-chrome-wire-shelving-with-48-giant-stacking-bins-red>: HTTP status code is not handled or not allowed
2026-01-10 17:49:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/odp-w-rigid-base-3hp-1800rpm-f2-mount>: HTTP status code is not handled or not allowed
2026-01-10 17:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:49:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-high-security-combo-padlock-with-key-control>: HTTP status code is not handled or not allowed
2026-01-10 17:49:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-lock-high-security-solid-aluminum-padlock-5-pin-cylinders-green>: HTTP status code is not handled or not allowed
2026-01-10 17:49:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x74-chrome-wire-shelving-with-24-6-h-shelf-bins-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:50:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14x36x74-chrome-wire-shelving-with-28-giant-stacking-bins-ivory>: HTTP status code is not handled or not allowed
2026-01-10 17:50:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-built-in-combination-deadbolt-lock-green-dial-left-hinged>: HTTP status code is not handled or not allowed
2026-01-10 17:50:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x74-chrome-wire-shelving-with-20-giant-stacking-bins-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:50:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-x-36h-round-counter-height-pedestal-table-studio-teak-top-round-black-base>: HTTP status code is not handled or not allowed
2026-01-10 17:50:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-1-12-thick-x-18-wide-x-18-long>: HTTP status code is not handled or not allowed
2026-01-10 17:50:06 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits landed on page that is not a product page.
2026-01-10 17:50:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-general-security-combo-padlock-purple-dial>: HTTP status code is not handled or not allowed
2026-01-10 17:50:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-built-in-key-operated-manual-deadbolt-locking-lock-keyed-alike>: HTTP status code is not handled or not allowed
2026-01-10 17:50:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/balance-board-28-l-x-26-w-x-5-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:50:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4703 pages (at 98 pages/min), scraped 1977 items (at 40 items/min)
2026-01-10 17:50:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-built-in-combo-lock-for-horizontal-latch-box-locker-rh>: HTTP status code is not handled or not allowed
2026-01-10 17:50:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x36x75-steel-shelving-with-24-giant-stacking-bins-green>: HTTP status code is not handled or not allowed
2026-01-10 17:50:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-130-sheet-heavy-duty-stapler-6-case>: HTTP status code is not handled or not allowed
2026-01-10 17:50:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xxl-balance-board-birch-wood-with-red-balls>: HTTP status code is not handled or not allowed
2026-01-10 17:50:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-konnect-153-stackable-storage-cups-3-pack-white-6-case>: HTTP status code is not handled or not allowed
2026-01-10 17:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/cart_truck_accessories/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:50:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-containment-berm-rapid-rise-model-15-x-66>: HTTP status code is not handled or not allowed
2026-01-10 17:50:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screw-for-8300-8400-8500-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 17:50:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tumbler-nt-12oz-slate-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:50:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bowl-boullion-8-4oz-beige>: HTTP status code is not handled or not allowed
2026-01-10 17:50:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/haws-axion-advantage-ax13-eye-face-wash-system-abs-plastic>: HTTP status code is not handled or not allowed
2026-01-10 17:50:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tumbler-nt-22oz-amber>: HTTP status code is not handled or not allowed
2026-01-10 17:50:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-plastic-bar-w-lse-acrylic-adhesive-12-thick-x-1-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:50:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tumbler-clrw-9-5oz-24qty-amber>: HTTP status code is not handled or not allowed
2026-01-10 17:50:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/cart_truck_accessories/pallet_truck_parts_accessories/pallet_truck_wheel_kits>: HTTP status code is not handled or not allowed
2026-01-10 17:50:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pivot-axle-for-ptw-series-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 17:50:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microflex-174-supreno-174-ec-sec-375-nitrile-gloves-powder-free-size-s-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:50:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inter-lok-angle-frame-mirror-18-w-x-36-h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:50:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-8482-tear-drop-pallet-rack-starter-96-w-x-24-d-x-96-h>: HTTP status code is not handled or not allowed
2026-01-10 17:50:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slb-lever-hoists-1650-lb-capacity-5-ft-lift-13-head-room>: HTTP status code is not handled or not allowed
2026-01-10 17:50:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plate-dw-salad-7-1-4-slate-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:50:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-332-thick-x-1-14-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:50:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plate-dw-nrwrm-9-white>: HTTP status code is not handled or not allowed
2026-01-10 17:50:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-merv-8-standard-capacity-xl8-pleated-panel-ext-surface-25-inch-w-x-25-inch-h-x-1-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 17:50:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-merv-8-standard-capacity-xl8-pleated-panel-ext-surface-12-inch-w-x-20-inch-h-x-2-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 17:50:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-tote-clear-t183-14l-x-12w-x-4h>: HTTP status code is not handled or not allowed
2026-01-10 17:50:39 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:50:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xx-garolite-rod-516-diameter-x-1-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 17:50:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-bank-roller-cabinet-w-4-drawers-27-w-x-22-3-8-d-x-38-1-2-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:50:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x42x75-steel-shelving-with-21-magnum-giant-hopper-bins-black>: HTTP status code is not handled or not allowed
2026-01-10 17:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:50:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-merv-13-high-capacity-extended-surface-multi-pleat-green-12-inch-w-x-24-inch-h-x-2-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 17:50:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-deluxe-thermoplastic-32-gal-perf-recycling-receptacle-w-multi-stream-lid-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:50:44 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:50:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x42x74-chrome-shelving-with-8-magnum-giant-hopper-bins-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:50:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-uhmw-polyethylene-plastic-sheet-38-thick-x-24-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:50:46 [py.warnings] (PID: 62) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2026-01-10 17:50:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zurn-z825a2-deck-mounted-gooseneck-lab-faucet>: HTTP status code is not handled or not allowed
2026-01-10 17:50:47 [scrapy.extensions.feedexport] (PID: 62) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:2
2026-01-10 17:50:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gripper-front-butcher-coat-wknit-cuffs-pocket-less-spun-polyester-tan-l>: HTTP status code is not handled or not allowed
2026-01-10 17:50:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gripper-front-butcher-coat-wexterior-top-pocket-spun-polyester-white-4xl>: HTTP status code is not handled or not allowed
2026-01-10 17:50:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zurn-z7000-s9-low-flow-shower-head-1-5gpm>: HTTP status code is not handled or not allowed
2026-01-10 17:50:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-sner-electric-chain-hoist-hook-suspension-1-15-14>: HTTP status code is not handled or not allowed
2026-01-10 17:50:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 17:50:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-rectangular-picnic-table-w-seat-cushions-expanded-metal-black>: HTTP status code is not handled or not allowed
2026-01-10 17:50:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gripper-front-butcher-coat-wknit-cuffs-pocket-less-spun-polyester-tan-3xl>: HTTP status code is not handled or not allowed
2026-01-10 17:50:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-2-12-thick-x-6-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:50:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-button-front-chef-coat-thermometer-pocket-cloth-buttons-white-polycotton-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:50:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pre-filled-container-40ml-1-34-oz-click-close-lid-attached-hazard-label-96-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:50:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/107-series-duo-trac-tractor-tire-chains-pair-1079610>: HTTP status code is not handled or not allowed
2026-01-10 17:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/composites/composite_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:51:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/over-conveyor-packing-stand-oc-1501-59-x-24-x-84-1-2>: HTTP status code is not handled or not allowed
2026-01-10 17:51:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unisex-mid-length-bib-apron-black-polyestercotton-30-x-33>: HTTP status code is not handled or not allowed
2026-01-10 17:51:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x74-chrome-wire-shelving-with-33-4-h-shelf-bins-red>: HTTP status code is not handled or not allowed
2026-01-10 17:51:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ballymore-10-step-perforated-cantilever-ladder-35-overhang>: HTTP status code is not handled or not allowed
2026-01-10 17:51:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caster-wheel-assembly-for-pe-pw-pc-series-pallet-trucks-cr-083179-a-sg>: HTTP status code is not handled or not allowed
2026-01-10 17:51:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polycarbonate-plastic-sheet-116-thick-x-32-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:51:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdpe-plastic-bar-34-thick-x-1-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/retail_fixtures_displays_equipment/garment_supplies/sewing_machines already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:51:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-for-mpb030-040-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 17:51:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4793 pages (at 90 pages/min), scraped 2014 items (at 37 items/min)
2026-01-10 17:51:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hercules-imagination-series-contemporary-leathersoft-middle-chair-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:51:10 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/composites/composite_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/composites/composite_bar_stock landed on page that is not a product page.
2026-01-10 17:51:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-w-lse-acrylic-adhesive-18-thick-x-2-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:51:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roller-grill-18-hot-dogs-gripsit>: HTTP status code is not handled or not allowed
2026-01-10 17:51:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xx-garolite-bar-116-thick-x-4-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/office_furniture/literature_mail_sorters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:51:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/71-inch-credenza-shell-in-dark-cherry-executive-modular-furniture>: HTTP status code is not handled or not allowed
2026-01-10 17:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/office_furniture/literature_mail_sorters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:51:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-spacer-for-7400-reach-pallet-trucks-5-x-2-88-wheels-open-toe>: HTTP status code is not handled or not allowed
2026-01-10 17:51:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-2-thick-x-48-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:51:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/foodservice/retail_fixtures_displays_equipment/garment_supplies/sewing_machines>: HTTP status code is not handled or not allowed
2026-01-10 17:51:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/balancing-damper-radial-galvanized-steel-12-pk10>: HTTP status code is not handled or not allowed
2026-01-10 17:51:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/barrier-free-cooler-hac-8fs-q-ada-pv>: HTTP status code is not handled or not allowed
2026-01-10 17:51:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-pocket-counter-top-business-card-holder-medium-oak>: HTTP status code is not handled or not allowed
2026-01-10 17:51:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bushing-for-mpb-040-e-b827-mpw-045-e-b802-pallet-trucks-yl-272015100>: HTTP status code is not handled or not allowed
2026-01-10 17:51:23 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/office_furniture/literature_mail_sorters> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/office_furniture/literature_mail_sorters landed on page that is not a product page.
2026-01-10 17:51:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheelbarrow-ladder-8-steps-aluminum-350-lb-capacity-14-d-top-step-24-w-step>: HTTP status code is not handled or not allowed
2026-01-10 17:51:25 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/office_furniture/literature_mail_sorters> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/office_furniture/literature_mail_sorters landed on page that is not a product page.
2026-01-10 17:51:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solenoid-switch-for-mp-mpb-040-ac-pallet-trucks-yl-501270305>: HTTP status code is not handled or not allowed
2026-01-10 17:51:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-8482-outdoor-bottle-filling-station-bi-level-fountain-w-water-filter-black>: HTTP status code is not handled or not allowed
2026-01-10 17:51:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stx422-electronic-portable-touchscreen-balance-420g-x-0-01g>: HTTP status code is not handled or not allowed
2026-01-10 17:51:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-riser-load-wheel-assembly-for-w-40z-b218-45z-c215-pallet-trucks-hy-2108789>: HTTP status code is not handled or not allowed
2026-01-10 17:51:28 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 17:51:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-for-w-40z-b218-45z-c215-pallet-trucks-hy-2046054>: HTTP status code is not handled or not allowed
2026-01-10 17:51:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/button-front-short-sleeve-cook-shirt-white-polyestercotton-3xl>: HTTP status code is not handled or not allowed
2026-01-10 17:51:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-boot-16-goliath-black-steel-toe-w-power-lug-outsole-pvc-size-12>: HTTP status code is not handled or not allowed
2026-01-10 17:51:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-14-thick-x-1-14-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:51:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x39-steel-shelving-with-16-6-h-shelf-bins-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:51:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-electric-pallet-jack-gwk-w40z-lw-xl-fits-hyster-w40z-b218-45z-c215>: HTTP status code is not handled or not allowed
2026-01-10 17:51:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-acetal-plastic-bar-12-thick-x-1-14-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 17:51:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pneumatic-hydraulic-mobile-scissor-lift-table-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:51:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-cover-for-mpb-040-e-b827-mpw-045-e-b802-pallet-trucks-yl-524144502>: HTTP status code is not handled or not allowed
2026-01-10 17:51:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-4-or-1-1-2-x-1-1-4-or-1-1-2-sump-pump-check-valve>: HTTP status code is not handled or not allowed
2026-01-10 17:51:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-electric-pallet-jack-gwk-mpw050e-lw-xl-fits-yale-model-mpw-050-e-c802>: HTTP status code is not handled or not allowed
2026-01-10 17:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/cart_truck_accessories/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:51:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-electric-pallet-jack-truck-gwk-7hbw30-lw-xl-fits-toyota-model-7hbw30>: HTTP status code is not handled or not allowed
2026-01-10 17:51:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24x48x74-chrome-wire-shelving-with-110-shelf-bins-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:51:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slide-box-for-50-slides-cork-lined-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:51:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-bar-1-thick-x-1-14-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:51:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cap-flange-plug-16mm-red-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:51:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-stacking-bin-8-1-4x10-3-4x7-black>: HTTP status code is not handled or not allowed
2026-01-10 17:51:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/advantage-200ls-half-mask-respirator-large-815700>: HTTP status code is not handled or not allowed
2026-01-10 17:51:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-stacking-bin-5-1-2x14-3-4x5-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:51:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/cart_truck_accessories/pallet_truck_parts_accessories/pallet_truck_wheel_kits>: HTTP status code is not handled or not allowed
2026-01-10 17:51:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/axial-exhaust-fan-500-cfm>: HTTP status code is not handled or not allowed
2026-01-10 17:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/cranes_hoists/hoists/electric_powered_hoists already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:51:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/msa-isobutylene-cylinder-100-liter-100-ppm-494450>: HTTP status code is not handled or not allowed
2026-01-10 17:51:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pigskin-leather-drivers-gloves-with-keystone-thumb-size-x2-pkg-qty-12>: HTTP status code is not handled or not allowed
2026-01-10 17:51:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-17-slicker-yellow-overboot-w-strap-cleated-outsole-pvc-size-14>: HTTP status code is not handled or not allowed
2026-01-10 17:51:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-38-thick-x-38-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:51:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-5821-20a-250v-nema-6-20r-2p-3w-single-recpt-grounding-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/fall_protection/self_retracting_lifelines_lanyards/self_retracting_lifelines already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:51:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-116-thick-x-3-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:52:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-35-hip-wader-black-plain-toe-w-cleated-outsole-pvc-size-13>: HTTP status code is not handled or not allowed
2026-01-10 17:52:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screw-cap-for-sample-tubes-with-external-threads-s-6030-6059-yellow-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:52:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/material-handling/cranes_hoists/hoists/electric_powered_hoists>: HTTP status code is not handled or not allowed
2026-01-10 17:52:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-cap-screw-m5-x-0-8-x-12mm-steel-zinc-clear-class-8-8-din-933-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 17:52:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/goodyear-fine-ribbed-rubber-floor-mat-3-5mm-thick-3-x-25-black>: HTTP status code is not handled or not allowed
2026-01-10 17:52:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elkay-lk4405bf-single-level-wall-mount-outdoor-pedestal-fountain-with-water-refilling-station>: HTTP status code is not handled or not allowed
2026-01-10 17:52:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-cap-screw-hhcs050094eg-1-2-13-x-1-796982>: HTTP status code is not handled or not allowed
2026-01-10 17:52:08 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/fall_protection/self_retracting_lifelines_lanyards/self_retracting_lifelines> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/fall_protection/self_retracting_lifelines_lanyards/self_retracting_lifelines landed on page that is not a product page.
2026-01-10 17:52:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/76575-eclipse-climaplus-ceiling-panels-mineral-fiber-white-24-x-24>: HTTP status code is not handled or not allowed
2026-01-10 17:52:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-safety-padlock-dielectric-zenex-1-12w-x-1-34h-green>: HTTP status code is not handled or not allowed
2026-01-10 17:52:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4886 pages (at 93 pages/min), scraped 2049 items (at 35 items/min)
2026-01-10 17:52:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-uhmw-polyethylene-plastic-sheet-34-thick-x-48-wide-x-72-long>: HTTP status code is not handled or not allowed
2026-01-10 17:52:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tach-it-3567-semi-automatic-twist-tie-machine-1-2-inch-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:52:12 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 17:52:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-safety-padlock-zenex-1-12w-x-3h-orange>: HTTP status code is not handled or not allowed
2026-01-10 17:52:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fb-pic4188h-luxury-color-sewer-drain-camera-130-cable-w-sonde-transmitter-footage-counter>: HTTP status code is not handled or not allowed
2026-01-10 17:52:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microscope-cover-glass-24mm-x-24mm--1-thickness-1-oz-vacuum-pack-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:52:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-only-medium-weight-sorbent-pads-19-gallon-capacity-15-x-18-100-padsbag>: HTTP status code is not handled or not allowed
2026-01-10 17:52:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-lockout-hasp-aluminum-1-jaw-dia-x-1-12w-x-4-38l>: HTTP status code is not handled or not allowed
2026-01-10 17:52:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-332-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 17:52:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microscope-slides-glass-25-x-75mm-90-ground-edges-safety-corners-tan-frosted-144-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:52:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transfer-pipet-5ml-fine-tip-153mm-sterile-polypropylenes-400-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:52:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/46in-round-metal-mesh-picnic-table-black>: HTTP status code is not handled or not allowed
2026-01-10 17:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:52:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h-stand-support-for-12-oaw-skatewheel-10-bf-roller-conveyors-adjustable-31-to-43h>: HTTP status code is not handled or not allowed
2026-01-10 17:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:52:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transfer-pipet-50ml-general-purpose-graduated-to-225ml-150mm-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/overboots_overshoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:52:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/americana-cap-with-accessory-slots-and-4-point-mega-ratchet-suspension-black>: HTTP status code is not handled or not allowed
2026-01-10 17:52:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transfer-pipet-70ml-large-bulb-graduated-to-3ml-155mm-sterile-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:52:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-132-thick-x-14-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 17:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/rainwear already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:52:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-drawer-counter-high-24-w-cabinet-everest-blue-4>: HTTP status code is not handled or not allowed
2026-01-10 17:52:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/matrix-guard-panel-4-10-w-x-2-h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:52:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/americana-cap-vented-with-accessory-slots-and-4-point-mega-ratchet-suspension-hi-viz-pink>: HTTP status code is not handled or not allowed
2026-01-10 17:52:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100g-3-point-hitch-sprayer-pto-6500c-pump-50-38-hose>: HTTP status code is not handled or not allowed
2026-01-10 17:52:33 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:52:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-1340vs-with-acu-rite-303-dro-with-taper-attachment-and-collet-closer>: HTTP status code is not handled or not allowed
2026-01-10 17:52:34 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 17:52:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/overboots_overshoes>: HTTP status code is not handled or not allowed
2026-01-10 17:52:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-inch-npt-brass-thermowell-6-inch-stem>: HTTP status code is not handled or not allowed
2026-01-10 17:52:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digital-pocket-thermometer>: HTTP status code is not handled or not allowed
2026-01-10 17:52:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/rainwear>: HTTP status code is not handled or not allowed
2026-01-10 17:52:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/undercounter-refrigerator-33-38f-48-38w-30-18d-tuc-48d-4-ada>: HTTP status code is not handled or not allowed
2026-01-10 17:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=jtm-1254vs-with-newall-dp700-dro-x-y-powerfeeds-air-power-drawbar already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:52:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/centrifuge-mini-8-place-240v-50hz-blue-lid-7000-rpm-fixed-speed-eu-plug>: HTTP status code is not handled or not allowed
2026-01-10 17:52:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ac2m15-bk-15m-49-2-ft-high-speed-hdmi-cable-with-ethernet>: HTTP status code is not handled or not allowed
2026-01-10 17:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/emergency_eyewash_stations_showers/portable_emergency_eyewash_stations already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:52:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-cap-for-wg-4-silver-gray-left-return>: HTTP status code is not handled or not allowed
2026-01-10 17:52:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wp3476-wh-cat-6-quick-connect-rj45-keystone-insert-white>: HTTP status code is not handled or not allowed
2026-01-10 17:52:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-pro-undercounter-refrigerator-33-38f-48-38w-30-18d-tuc-48-lp>: HTTP status code is not handled or not allowed
2026-01-10 17:52:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microscope-slides-glass-25-x-75mm-45-beveled-edges-clipped-corners-orange-frosted1440-pk>: HTTP status code is not handled or not allowed
2026-01-10 17:52:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-drawer-bench-high-30-w-cabinet-black-1>: HTTP status code is not handled or not allowed
2026-01-10 17:52:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-1254vs-with-acu-rite-200s-3x-q-dro-x-y-z-powerfeeds-air-power-drawbar>: HTTP status code is not handled or not allowed
2026-01-10 17:52:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-1254vs-with-newall-dp700-3x-k-dro-x-powerfeed-air-power-drawbar>: HTTP status code is not handled or not allowed
2026-01-10 17:52:51 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=jtm-1254vs-with-newall-dp700-dro-x-y-powerfeeds-air-power-drawbar> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=jtm-1254vs-with-newall-dp700-dro-x-y-powerfeeds-air-power-drawbar landed on page that is not a product page.
2026-01-10 17:52:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jmd-40g-hpf-geared-head-mill-drill-with-power-downfeed-newall-dp500-2-axis-dro>: HTTP status code is not handled or not allowed
2026-01-10 17:52:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/emergency_eyewash_stations_showers/portable_emergency_eyewash_stations>: HTTP status code is not handled or not allowed
2026-01-10 17:52:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bottle-cooler-flat-top-36-34w-26-58d-33-38h-td-36-12>: HTTP status code is not handled or not allowed
2026-01-10 17:52:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-aquamax-plastic-locker-double-tier-1-wide-12w-x-18d-x-36h-taupe-body-blue-doors>: HTTP status code is not handled or not allowed
2026-01-10 17:52:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welding-cable-lead-reel-fixed-base-double>: HTTP status code is not handled or not allowed
2026-01-10 17:52:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/female-double-swivel-ring-u038>: HTTP status code is not handled or not allowed
2026-01-10 17:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=e-1340vs-with-acu-rite-303-css-dro-with-collet-closer already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:52:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30in-direct-drive-heavy-duty-portable-air-circulator-bf30dd-red-5500-cfm>: HTTP status code is not handled or not allowed
2026-01-10 17:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/floor_cleaners already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:52:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gh-1440-3-with-newall-dp700-dro>: HTTP status code is not handled or not allowed
2026-01-10 17:53:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-1254rvs-with-newall-dp700-3x-q-dro-x-y-powerfeeds-air-power-drawbar>: HTTP status code is not handled or not allowed
2026-01-10 17:53:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blue-ridge-ergonomics-task-stool-carbon>: HTTP status code is not handled or not allowed
2026-01-10 17:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=evs-949-mill-3-axis-acu-rite-203-quill-dro-x-y-axis-jet-powerfeeds-usa-p-drw-br already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:53:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/etm-949evs-mill-with-2-axis-acu-rite-millpwr-cnc>: HTTP status code is not handled or not allowed
2026-01-10 17:53:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-gear-locker-with-door-foot-locker-legs-24x24x72-red>: HTTP status code is not handled or not allowed
2026-01-10 17:53:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipette-diamond-fixed-volume-15ul-pink>: HTTP status code is not handled or not allowed
2026-01-10 17:53:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/19-902-9152-multi-link-asian-interchange-1-4-body-size-safety-esafe-kit-2-out-1-2-fem-inlet>: HTTP status code is not handled or not allowed
2026-01-10 17:53:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/etm-949-mill-with-2-axis-acu-rite-203-dro-and-x-axis-jet-powerfeed>: HTTP status code is not handled or not allowed
2026-01-10 17:53:08 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=e-1340vs-with-acu-rite-303-css-dro-with-collet-closer> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=e-1340vs-with-acu-rite-303-css-dro-with-collet-closer landed on page that is not a product page.
2026-01-10 17:53:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/floor_cleaners>: HTTP status code is not handled or not allowed
2026-01-10 17:53:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 4976 pages (at 90 pages/min), scraped 2082 items (at 33 items/min)
2026-01-10 17:53:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hanging-tailpipe-rack-96x18x120>: HTTP status code is not handled or not allowed
2026-01-10 17:53:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triton-lbs18k-slv-silver-key-pegboard-kit>: HTTP status code is not handled or not allowed
2026-01-10 17:53:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/searchResult?q=evs-949-mill-3-axis-acu-rite-203-quill-dro-x-y-axis-jet-powerfeeds-usa-p-drw-br>: HTTP status code is not handled or not allowed
2026-01-10 17:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=evs-949-mill-with-x-y-axis-jet-powerfeeds-and-usa-powered-draw-bar already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:53:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insight-variable-adf-welding-helmet-shade-9-13-stars-scars-hlx-100-series>: HTTP status code is not handled or not allowed
2026-01-10 17:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/medical_laboratory_refrigeration/medical_freezers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:53:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/binclip-for-pegboard-797000>: HTTP status code is not handled or not allowed
2026-01-10 17:53:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microcentrifuge-tube-20ml-polypropylene-orange-stand-up-zipbag-mg-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:53:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bowl-pebble-camwear-round-12-pebbled>: HTTP status code is not handled or not allowed
2026-01-10 17:53:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slide-draining-tray-100-place-for-up-to-200-slides-abs-white-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:53:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-mobile-dunnage-rack-42x20x8>: HTTP status code is not handled or not allowed
2026-01-10 17:53:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/market-tray-18x26-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:53:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15sp15c-1p-1-5-inch-cast-iron-self-priming-cf-pump-130gpm-125psi-epdm-epr-seal-1-1-2hp>: HTTP status code is not handled or not allowed
2026-01-10 17:53:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-glamour-bubble-mailer-9-x-11-1-2>: HTTP status code is not handled or not allowed
2026-01-10 17:53:23 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=evs-949-mill-with-x-y-axis-jet-powerfeeds-and-usa-powered-draw-bar> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=evs-949-mill-with-x-y-axis-jet-powerfeeds-and-usa-powered-draw-bar landed on page that is not a product page.
2026-01-10 17:53:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/medical-lab/medical_laboratory_refrigeration/medical_freezers>: HTTP status code is not handled or not allowed
2026-01-10 17:53:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camdolly-milk-crate-slate-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:53:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-36-mobile-phenolic-resin-safety-lab-bench-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:53:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-step-stock-picking-ladder-perforated-tread-spl-8-np>: HTTP status code is not handled or not allowed
2026-01-10 17:53:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-step-stock-picking-ladder-perforated-tread-spl-10-p>: HTTP status code is not handled or not allowed
2026-01-10 17:53:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4250-98-3x2-inch-316-ss-heavy-duty-straight-centrifugal-pump-viton-seal-10hp-215jm-3-phase-motor>: HTTP status code is not handled or not allowed
2026-01-10 17:53:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cambox-cutlery-insert-box-hi-gloss-plastic-black>: HTTP status code is not handled or not allowed
2026-01-10 17:53:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-easy-fold-mailer-9-5-8-x-6-5-8-x-2-1-2>: HTTP status code is not handled or not allowed
2026-01-10 17:53:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beaker-diamond-essentials-griffin-style-low-form-printed-graduations-pmp-5000ml>: HTTP status code is not handled or not allowed
2026-01-10 17:53:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/berries-plastic-chair-with-powder-coated-legs-12-ht-camel>: HTTP status code is not handled or not allowed
2026-01-10 17:53:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1853-sd-42-3-00mm-x-3mm-standard-cut-ball-shaped-bur>: HTTP status code is not handled or not allowed
2026-01-10 17:53:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1848-sf-5l6-1-2-x-1-4-double-cut-round-nose-tree-bur>: HTTP status code is not handled or not allowed
2026-01-10 17:53:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kraft-triple-wall-corrugated-sheets-48-x-96>: HTTP status code is not handled or not allowed
2026-01-10 17:53:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m6-1-0-x-80mm-din-7985-phillips-drive-pan-head-zinc-finish-steel-machine-screw-pkg-100>: HTTP status code is not handled or not allowed
2026-01-10 17:53:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-5-step-steel-24w-x-48d-work-platform-ladder>: HTTP status code is not handled or not allowed
2026-01-10 17:53:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1854-sh-2l6-5-16-x-1-4-standard-cut-flame-shaped-bur>: HTTP status code is not handled or not allowed
2026-01-10 17:53:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/400xl100-standard-timing-belt-xl-1-x-40-t200-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 17:53:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-overbed-clipboard-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:53:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bottle-narrow-mouth-polypropylene-attached-polypropylene-screw-cap-500ml-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:53:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inlet-weatherhood-with-birdscreen-16-exhaust-fan>: HTTP status code is not handled or not allowed
2026-01-10 17:53:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/280xl025-standard-timing-belt-xl-1-4-x-28-t140-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 17:53:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-aluminum-rolling-ladder-24w-ribbed-tread-14d-top-step>: HTTP status code is not handled or not allowed
2026-01-10 17:53:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1849-sg-53-4-76mm-x-12-7mm-double-cut-pointed-tree-bur>: HTTP status code is not handled or not allowed
2026-01-10 17:53:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rack-tube-16-17mm-10-place-polypropylene-white>: HTTP status code is not handled or not allowed
2026-01-10 17:53:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-x-40-roll-ultimat-ii-light-blue-ur-3040xlb>: HTTP status code is not handled or not allowed
2026-01-10 17:53:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/126xl037-standard-timing-belt-xl-3-8-x-12-5-8-t63-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 17:53:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-black-stealthnet-standard-duty-bird-netting-25-x-75-n1-b130>: HTTP status code is not handled or not allowed
2026-01-10 17:53:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/138xl050-standard-timing-belt-xl-1-2-x-13-13-16-t69-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 17:53:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-vacuum-cleaner-bags-for-windsor-chariot-2-atv-ivac-24>: HTTP status code is not handled or not allowed
2026-01-10 17:54:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-1-4-x-47-1-2-h-deluxe-office-partition-panel-electric-gray-277543gy>: HTTP status code is not handled or not allowed
2026-01-10 17:54:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supco-pressure-switch-350-psi-open-250-psi-closed>: HTTP status code is not handled or not allowed
2026-01-10 17:54:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-1-4-x-47-1-2-h-deluxe-office-partition-panel-non-electric-w-raceway-gray-277564gy>: HTTP status code is not handled or not allowed
2026-01-10 17:54:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/322l037-standard-timing-belt-l-3-8-x-32-3-16-t86-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 17:54:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supco-pressure-switch-40-psi-open-80-psi-closed>: HTTP status code is not handled or not allowed
2026-01-10 17:54:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supco-manual-reset-pressure-switch-410-psi-open>: HTTP status code is not handled or not allowed
2026-01-10 17:54:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/banking-vault-safe-interiors-3-compartment-2303-17-i-16-1-4w-x-17d-x-15-11-16h-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:54:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/penco-vanguard-box-over-locker-18x21x72-champagne>: HTTP status code is not handled or not allowed
2026-01-10 17:54:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-mount-round-safety-bollard-with-plastic-cap-and-base-yellow-48-inch-height>: HTTP status code is not handled or not allowed
2026-01-10 17:54:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5070 pages (at 94 pages/min), scraped 2126 items (at 44 items/min)
2026-01-10 17:54:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-mailbox-mailbox-b-9-w-x-21-d-x-7-h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:54:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-174-medium-blue-looped-mop-head-wide-band>: HTTP status code is not handled or not allowed
2026-01-10 17:54:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quick-attach-pole-pusher-for-motorized-hand-trucks>: HTTP status code is not handled or not allowed
2026-01-10 17:54:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/temperature-test-chamber-double-solid-door-49-cu-ft-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:54:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/structural-plastic-solid-shelving-48-x-24-x-75>: HTTP status code is not handled or not allowed
2026-01-10 17:54:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/structural-plastic-solid-shelving-66-x-36-x-51>: HTTP status code is not handled or not allowed
2026-01-10 17:54:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/internal-coupling-fittings-1-14dia-furniture-grade-pvc-white>: HTTP status code is not handled or not allowed
2026-01-10 17:54:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graduated-cylinder-polypropylene-printed-graduations-100ml-30-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:54:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wireless-tube-rack-with-rfid-for-captrack-ct1-and-ct2-models-half-size-13mm-36-place-blue->: HTTP status code is not handled or not allowed
2026-01-10 17:54:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wireless-tube-rack-with-rfid-for-captrack-ct1-and-ct2-models-half-size-13mm-36-place-white>: HTTP status code is not handled or not allowed
2026-01-10 17:54:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tork-xpressnap-fit-napkin-dispenser-7232000>: HTTP status code is not handled or not allowed
2026-01-10 17:54:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1325h150-standard-timing-belt-h-1-1-2-x-132-1-2-t265-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 17:54:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-channel-beam-96-w-x-48-d-x-84-h-4-level-add-on-no-deck-tan>: HTTP status code is not handled or not allowed
2026-01-10 17:54:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graduated-cylinder-polypropylene-molded-graduations-250ml>: HTTP status code is not handled or not allowed
2026-01-10 17:54:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ec150-conductivitytdstemperature-meter-ec150-protective-cap-4x-button-cell-batteries>: HTTP status code is not handled or not allowed
2026-01-10 17:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/testing_inspection_instruments/electrical_power_testing/multimeters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:54:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rf12-portable-brix-refractometer-018-brix>: HTTP status code is not handled or not allowed
2026-01-10 17:54:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beaker-polypropylene-printed-graduations-50ml-20-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:54:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-only-boom-pillows-10-bale-18-x-8>: HTTP status code is not handled or not allowed
2026-01-10 17:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:54:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-25b30hx38mpb-14-pitch-38-plain-bore-30-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:54:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/octagon-sign-base-with-98h-post-green-8w-x-20h-base>: HTTP status code is not handled or not allowed
2026-01-10 17:54:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smooth-bollard-post-sleeve-10-hdpe-dome-top-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:54:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pneumatic-engraving-pen-kit-with-3-stylus-2-5-cfm-18750-bpm>: HTTP status code is not handled or not allowed
2026-01-10 17:54:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carbon-monoxide-gas-cylinder-1016-200-ppm-bal-n2-17l-p>: HTTP status code is not handled or not allowed
2026-01-10 17:54:39 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/testing_inspection_instruments/electrical_power_testing/multimeters> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/testing_inspection_instruments/electrical_power_testing/multimeters landed on page that is not a product page.
2026-01-10 17:54:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ice-caddies-slate-blue-175-lbs-cap-short-2-fixed-2-swivel-1-with-brake>: HTTP status code is not handled or not allowed
2026-01-10 17:54:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rackable-plastic-pallet-48x40x6-1-2-3300-lbs>: HTTP status code is not handled or not allowed
2026-01-10 17:54:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extension-kit-for-multi-user-mechanical-lock>: HTTP status code is not handled or not allowed
2026-01-10 17:54:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents landed on page that is not a product page.
2026-01-10 17:54:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydrofarm-ck64001-vented-humidity-dome-2-for-seeding-tray->: HTTP status code is not handled or not allowed
2026-01-10 17:54:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/siesta-cross-resin-outdoor-chair-taupe>: HTTP status code is not handled or not allowed
2026-01-10 17:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/adhesives_sealants_tape/adhesives_glue/general_purpose_glue already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:54:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-12a30h-metric-a-plate-34-pitch-19mm-bore-30-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:54:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chesapeake-86776-14-inch-high-pvc-boot-safety-toe-size-15-black>: HTTP status code is not handled or not allowed
2026-01-10 17:54:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8916-glowear-174-class-e-lightweight-hi-vis-rain-pants-lime-2xl>: HTTP status code is not handled or not allowed
2026-01-10 17:54:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-5-5-8-split-capacitor-condenser-fan-motor-825-rpm-460-volts>: HTTP status code is not handled or not allowed
2026-01-10 17:54:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-fan-blower-duty-1050-rpm-115-volts>: HTTP status code is not handled or not allowed
2026-01-10 17:54:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8366-glowear-174-type-r-class-3-lightweight-hi-vis-rain-jacket-lime-s>: HTTP status code is not handled or not allowed
2026-01-10 17:54:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bottle-with-screwcap-narrow-mouth-ldpe-graduated-2000ml-20-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:54:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs16hx134-1-pitch-1-34-finished-bore-16-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:54:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-mode-earplugs-reusable-corded-nrr-4db-24db-50-pairs-box>: HTTP status code is not handled or not allowed
2026-01-10 17:54:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-supplies/adhesives_sealants_tape/adhesives_glue/general_purpose_glue> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-supplies/adhesives_sealants_tape/adhesives_glue/general_purpose_glue landed on page that is not a product page.
2026-01-10 17:54:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/structural-plastic-shelf-leg-36in>: HTTP status code is not handled or not allowed
2026-01-10 17:54:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prolube-43973-grease-fitting-set-metric-80-piece>: HTTP status code is not handled or not allowed
2026-01-10 17:54:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/groz-44134-vertical-lift-safety-pump-15-55-gallon-drum>: HTTP status code is not handled or not allowed
2026-01-10 17:55:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microtube-15ml-self-standing-polypropylene-no-cap-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:55:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vornado-460-whole-room-circulator>: HTTP status code is not handled or not allowed
2026-01-10 17:55:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-capacitor-start-resilient-base-motor-115-230-volts-1725-rpm-2>: HTTP status code is not handled or not allowed
2026-01-10 17:55:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-bank-5a-onboard-battery-charger>: HTTP status code is not handled or not allowed
2026-01-10 17:55:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-25b21hx14mpb-14-pitch-14-plain-bore-21-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:55:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-care-20-x25-x5-wide-frame-electrostatic-air-filter-merv-8>: HTTP status code is not handled or not allowed
2026-01-10 17:55:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cap-plug-11mm-natural-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:55:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/packard-c-frame-nutone-replacement-motor-120-volts-3000-rpm-6>: HTTP status code is not handled or not allowed
2026-01-10 17:55:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5162 pages (at 92 pages/min), scraped 2167 items (at 41 items/min)
2026-01-10 17:55:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-4-4-shaded-pole-motor-115-volts-1550-rpm-3>: HTTP status code is not handled or not allowed
2026-01-10 17:55:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drying-rack-72-place-removable-pegs-high-impact-polystyrene>: HTTP status code is not handled or not allowed
2026-01-10 17:55:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/made-in-usa-2-2-white-red-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:55:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bat-135-battery-tester-with-integrated-printer>: HTTP status code is not handled or not allowed
2026-01-10 17:55:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bubble-bags-6-x-9-650-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:55:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/number-3-hydraulic-adjustable-height-packing-workbench-laminate-square-edge-72-x-30-black>: HTTP status code is not handled or not allowed
2026-01-10 17:55:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cassette-biopsy-embedding-with-attached-lid-30-writing-area-blue-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:55:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-6-fluorescent-pink>: HTTP status code is not handled or not allowed
2026-01-10 17:55:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100sk14h-taper-bushed-1-14-pitch-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:55:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60a27hx1-a-plate-34-pitch-1-bore-27-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:55:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-3-5>: HTTP status code is not handled or not allowed
2026-01-10 17:55:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-twist-ties-4-x-5-32-red-candy-stripe-2000-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:55:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-ton-king-pin-pusher-set>: HTTP status code is not handled or not allowed
2026-01-10 17:55:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-tier-3-door-premium-steel-locker-12-w-x-15-d-x-72-h-light-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 17:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/medical_devices_instruments/thermometers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:55:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rechargeable-battery-kbep-bat>: HTTP status code is not handled or not allowed
2026-01-10 17:55:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-tier-1-door-premium-steel-locker-12-w-x-15-d-x-72-h-black-assembled>: HTTP status code is not handled or not allowed
2026-01-10 17:55:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-load-3-5-fluorescent-red-black>: HTTP status code is not handled or not allowed
2026-01-10 17:55:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs18hx112-34-pitch-1-12-finished-bore-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:55:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluorescent-green-3-5>: HTTP status code is not handled or not allowed
2026-01-10 17:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/hvac_electric_motors/unit_bearing_fan_motors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:55:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/special-order-3-5-bright-yellow-black>: HTTP status code is not handled or not allowed
2026-01-10 17:55:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-trash-can-lid-55-gallon-brown>: HTTP status code is not handled or not allowed
2026-01-10 17:55:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-dia-black-disc-with-20>: HTTP status code is not handled or not allowed
2026-01-10 17:55:36 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/medical_devices_instruments/thermometers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/medical_devices_instruments/thermometers landed on page that is not a product page.
2026-01-10 17:55:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40bs34hx1-12-pitch-1-finished-bore-34-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:55:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-1-1-2-mr-clip-cobalt-blue-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 17:55:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-41bs40x114-12-pitch-1-14-finished-bore-40-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:55:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curbside-truck-silver-ep-24w-x-30l-x-69h-4-wire-shelves-polyurethane-2-rigid-casters>: HTTP status code is not handled or not allowed
2026-01-10 17:55:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curbside-truck-chrome-21w-x-30l-x-69h-4-wire-shelves-polyurethane-2-rigid-casters>: HTTP status code is not handled or not allowed
2026-01-10 17:55:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs19hx118-34-pitch-1-18-finished-bore-19-teeth>: HTTP status code is not handled or not allowed
2026-01-10 17:55:43 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/hvac_electric_motors/unit_bearing_fan_motors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/hvac_electric_motors/unit_bearing_fan_motors landed on page that is not a product page.
2026-01-10 17:55:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bubble-lined-poly-mailers-7-14-1-4-x-20-white-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:55:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-to-ship-3-5-bright-yellow-black>: HTTP status code is not handled or not allowed
2026-01-10 17:55:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colorstar-impressions-custom-logo-mat--6--x-12--48-mil-universal-cleated-sbr>: HTTP status code is not handled or not allowed
2026-01-10 17:55:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-centrifugal-blower-115-volts-2900-rpm-2>: HTTP status code is not handled or not allowed
2026-01-10 17:55:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-bulk-storage-locker-single-tier-starter-48x36x90>: HTTP status code is not handled or not allowed
2026-01-10 17:55:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-3-teflon-protection-heavy-weight-sweatshirt-w-segment-tape-2xl>: HTTP status code is not handled or not allowed
2026-01-10 17:55:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-8482-automatic-hand-sanitizer-liquid-soap-dispenser-1200-ml-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:55:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/no-4696d-t-s-a-accepted-luggage-combination-padlock-1-5-16-inch-w-syo-black>: HTTP status code is not handled or not allowed
2026-01-10 17:55:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-green-discs-1-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:55:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smokers-outpost-wall-mounted-ashtray-locking-with-swivel-black>: HTTP status code is not handled or not allowed
2026-01-10 17:55:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ok-to-ship-3-5-fluorescent-green-black>: HTTP status code is not handled or not allowed
2026-01-10 17:55:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-piece-phillips-slotted-dual-material-screwdriver-set>: HTTP status code is not handled or not allowed
2026-01-10 17:55:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90-tooth-and-12-point-metric-combination-ratcheting-wrench-set-of-12>: HTTP status code is not handled or not allowed
2026-01-10 17:55:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/artisan-old-english-style-traditional-rug-8-ft-x-10-ft-red>: HTTP status code is not handled or not allowed
2026-01-10 17:56:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jelly-belly-50-flavors-jelly-beans-assortment-3-lb-gr>: HTTP status code is not handled or not allowed
2026-01-10 17:56:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wardrobe-storage-cabinet-standard-36x18x72-gray-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 17:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-ec2002b-2-hp-1-phase-3450-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:56:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blue-diamond-low-sodium-lightly-salted-almonds-1-5-oz-12-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 17:56:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-9034-1-6-hp-1-phase-1075-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ring-pop-individually-wrapped-lollipop-candy-40-count-bulk-tub-gr>: HTTP status code is not handled or not allowed
2026-01-10 17:56:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-wdp5e2ac-5-hp-3-phase-1755-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-dj7p2hm-7-5-hp-3-phase-1765-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-ec09b-1-hp-1-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5256 pages (at 94 pages/min), scraped 2209 items (at 42 items/min)
2026-01-10 17:56:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-drawer-mobile-multi-drawer-cabinet-48-wx27-dx37-1-2-h-beige-1>: HTTP status code is not handled or not allowed
2026-01-10 17:56:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swrfid-50g-rfid-impact-indicators-50g-range-red-100-box>: HTTP status code is not handled or not allowed
2026-01-10 17:56:12 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-ec2002b-2-hp-1-phase-3450-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-ec2002b-2-hp-1-phase-3450-rpm landed on page that is not a product page.
2026-01-10 17:56:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-5454-1-5-hp-1-phase-1075-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pom-wonderful-100-pomegranate-juice-12-oz-6-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 17:56:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-1860-1-4-hp-1-phase-1075-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-2867-1-5-hp-1-phase-1050-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-3783-1-4-hp-1-phase-1075-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/abt-hc-ucbi-0404-ada-premier-built-in-ada-compliant-undercounter-refrigerator-right-hinged-door-4-6-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 17:56:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-t2c2jh-2-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-t34ca2j-3-4-hp-1-phase-1725-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:56:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-max-xr-versa-clutch-adjustable-torque-screwgun-kit-dcf622m2>: HTTP status code is not handled or not allowed
2026-01-10 17:56:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frito-lay-variety-big-grab-30-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 17:56:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-step-16-w-stainless-steel-fold-store-ladder-perforated-tread>: HTTP status code is not handled or not allowed
2026-01-10 17:56:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-max-18-gauge-swivel-head-shears-bare-tool-only-dcs491b>: HTTP status code is not handled or not allowed
2026-01-10 17:56:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zcm1000p550s-auto-feed-cutter-unit-for-zcm1000-dispensers>: HTTP status code is not handled or not allowed
2026-01-10 17:56:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u1v3bc-1-hp-3-phase-1155-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-motorized-shut-off-damper-24v>: HTTP status code is not handled or not allowed
2026-01-10 17:56:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-motorized-shut-off-damper-24v>: HTTP status code is not handled or not allowed
2026-01-10 17:56:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regulator-ng-2-psig-min-inlet-boss-1000>: HTTP status code is not handled or not allowed
2026-01-10 17:56:30 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-t34ca2j-3-4-hp-1-phase-1725-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-t34ca2j-3-4-hp-1-phase-1725-rpm landed on page that is not a product page.
2026-01-10 17:56:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-72-vinyl-shower-curtain-white-pebble-embossed-10-gauge-12-per-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:56:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-h3t2bc-5-hp-3-phase-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u5v1bc-5-hp-3-phase-3520-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ego-cs1804-power-56v-18-cordless-chain-saw-kit-w-5-0ah-battery-charger>: HTTP status code is not handled or not allowed
2026-01-10 17:56:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-bungee-cord-with-over-molded-nylon-ends-black>: HTTP status code is not handled or not allowed
2026-01-10 17:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/automotive_shop_equipment/vehicle_lifts_jacks/transmission_jacks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:56:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn37-15-1-h-56c-cast-iron-helical-bevel-speed-reducer-56c-input-flange-15-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 17:56:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-d32c2p18z-1-5-hp-1-phase-1740-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-shelving-drawer-unit-36x18x75-108-drawers-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:56:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-assembled-electronic-access-locker-single-tier-1-wide-12x15x78>: HTTP status code is not handled or not allowed
2026-01-10 17:56:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylinder-graduated-globe-glass-class-b-to-deliver-td-dual-grads-astm-e1272-10ml-4-box>: HTTP status code is not handled or not allowed
2026-01-10 17:56:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-d7p1g-7-5-hp-3-phase-3505-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-174-6100564-fixed-ladder-srl-anchor-6-galvanized-1-ea>: HTTP status code is not handled or not allowed
2026-01-10 17:56:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-knock-down-antimicrobial-locker-double-tier-1-wide-12x18x78>: HTTP status code is not handled or not allowed
2026-01-10 17:56:46 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/vehicle-fleet-maintenance/automotive_shop_equipment/vehicle_lifts_jacks/transmission_jacks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/vehicle-fleet-maintenance/automotive_shop_equipment/vehicle_lifts_jacks/transmission_jacks landed on page that is not a product page.
2026-01-10 17:56:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-welded-double-point-ventilated-locker-double-tier-3-wide-12x12x72>: HTTP status code is not handled or not allowed
2026-01-10 17:56:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-assembled-corrosion-resistant-locker-single-tier-3-wide-12x15x78>: HTTP status code is not handled or not allowed
2026-01-10 17:56:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u1p3dc-1-hp-3-phase-1155-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strobe-120vac-pipe-mount-red-131st-120r>: HTTP status code is not handled or not allowed
2026-01-10 17:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-xs13ca1jcr-1-3-hp-1-phase-3450-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:56:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-rivet-steel-shelving-with-wood-deck-96-w-x-24-d-x-72-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/boltless_shelving/heavy_duty_boltless_shelves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:56:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-rivet-steel-shelving-with-wood-deck-72-w-x-24-d-x-84-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:56:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-fd32cm2phzy-1-1-2-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-galvanized-steel-blower-wheel-4-1-4-diameter-1-4-bore-2>: HTTP status code is not handled or not allowed
2026-01-10 17:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-yc5e3b-5-hp-3-phase-1170-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:56:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-master-link-1-5-inch-link-safety-green-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:56:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/connecting-s-hooks-1-5-inch-safety-orange-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 17:56:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-c250p1cs-250-hp-3-phase-3575-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:56:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gussetted-poly-bag-rolls-8x4x18-2-mil-1000-rl>: HTTP status code is not handled or not allowed
2026-01-10 17:57:00 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-xs13ca1jcr-1-3-hp-1-phase-3450-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-xs13ca1jcr-1-3-hp-1-phase-3450-rpm landed on page that is not a product page.
2026-01-10 17:57:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mattress-bags-54x8x90-1-5-mil-100-rl>: HTTP status code is not handled or not allowed
2026-01-10 17:57:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rs15i-a145-200-3-60-base-mount-145-psi>: HTTP status code is not handled or not allowed
2026-01-10 17:57:01 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/shelving/boltless_shelving/heavy_duty_boltless_shelves> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/shelving/boltless_shelving/heavy_duty_boltless_shelves landed on page that is not a product page.
2026-01-10 17:57:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hair-pin-assortment-carbon-steel-zinc-clear-276-piece>: HTTP status code is not handled or not allowed
2026-01-10 17:57:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-add-on-unit-5-vented-shelves-21x60x72>: HTTP status code is not handled or not allowed
2026-01-10 17:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-7040-1-3-hp-1-phase-825-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:57:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/searchResult?q=us-motor-yc5e3b-5-hp-3-phase-1170-rpm>: HTTP status code is not handled or not allowed
2026-01-10 17:57:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-kan67-20-1-h-182-4tc-cast-iron-helical-bevel-speed-reducer-182-4tc-input-flange-20-1>: HTTP status code is not handled or not allowed
2026-01-10 17:57:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-kan97-30-1-h-284-6tc-cast-iron-helical-bevel-speed-reducer-284-6tc-input-flange-30-1>: HTTP status code is not handled or not allowed
2026-01-10 17:57:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-kan87-80-1-182-4tc-cast-iron-helical-bevel-speed-reducer-182-4tc-input-flange-80-1>: HTTP status code is not handled or not allowed
2026-01-10 17:57:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kan-series-helical-bevel-speed-reducer-b5-output-flg-kit-size-87-b5-output-flg-kit-hardw-incl>: HTTP status code is not handled or not allowed
2026-01-10 17:57:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kan-series-helical-bevel-speed-reducer-b5-output-flg-kit-size-37-b5-output-flg-kit-hardw-incl>: HTTP status code is not handled or not allowed
2026-01-10 17:57:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5352 pages (at 96 pages/min), scraped 2247 items (at 38 items/min)
2026-01-10 17:57:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/versa-food-bars-work-table-cold-food-72-x-29-low-6-swivel-casters-with-brakes-black>: HTTP status code is not handled or not allowed
2026-01-10 17:57:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-strut-aluminum-walk-ramp-16-l-x-38-w>: HTTP status code is not handled or not allowed
2026-01-10 17:57:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reversible-top-fax-printer-stand>: HTTP status code is not handled or not allowed
2026-01-10 17:57:13 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-7040-1-3-hp-1-phase-825-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-7040-1-3-hp-1-phase-825-rpm landed on page that is not a product page.
2026-01-10 17:57:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-compartment-steel-literature-organizer-black>: HTTP status code is not handled or not allowed
2026-01-10 17:57:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermobarrier-21-1-4x13x1-1-2-removable-insulated-shelf-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:57:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-camcart-heated-food-pan-carrier-front-loading-granite-green-110v-60-1-ph-529-watts>: HTTP status code is not handled or not allowed
2026-01-10 17:57:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beverage-carrier-insulated-plastic-4-3-4-gallon-16-1-2x9x24-1-4-hot-red>: HTTP status code is not handled or not allowed
2026-01-10 17:57:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-storage-case-medim-21-1-2-x-16-1-4-x-18-1-2>: HTTP status code is not handled or not allowed
2026-01-10 17:57:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-locker-single-tier-1-wide-12-x-12-x-72-beige>: HTTP status code is not handled or not allowed
2026-01-10 17:57:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hot-cold-cart-tall-profile-granite-green>: HTTP status code is not handled or not allowed
2026-01-10 17:57:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermoplastic-rubber-round-bumper-guard-3-1-4-diameter-case-of-16>: HTTP status code is not handled or not allowed
2026-01-10 17:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:57:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/propane-heater-infrared-tube-175000-btu-50l>: HTTP status code is not handled or not allowed
2026-01-10 17:57:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-camtainer-beverage-carrier-insulated-plastic-10-1-2-gallon-capacity-granite-sand>: HTTP status code is not handled or not allowed
2026-01-10 17:57:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-thick-24-h-steel-post-protector-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:57:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-headroom-multiple-spread-li-ing-beam-6000-lb-capacity-3-long>: HTTP status code is not handled or not allowed
2026-01-10 17:57:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-run-tee-metal-release-collet-12mm-tube-x-3-8>: HTTP status code is not handled or not allowed
2026-01-10 17:57:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-forced-horizontal-discharge-unit-heater-5kw-240v-1ph>: HTTP status code is not handled or not allowed
2026-01-10 17:57:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/economy-flat-top-workbench-48-w-x-24-d-1>: HTTP status code is not handled or not allowed
2026-01-10 17:57:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bellows-package-for-bishamon-ez-loader-ez-40>: HTTP status code is not handled or not allowed
2026-01-10 17:57:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans>: HTTP status code is not handled or not allowed
2026-01-10 17:57:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cast-iron-jaw-coupling-hub-style-l100-1-2-inch-bore-diameter-1-8-x-1-16-keyway>: HTTP status code is not handled or not allowed
2026-01-10 17:57:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cast-iron-jaw-coupling-hub-style-l150-1-3-16-inch-bore-diameter-1-4-x-1-8-keyway>: HTTP status code is not handled or not allowed
2026-01-10 17:57:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-male-metal-release-collet-6mm-tube-x-1-8-swift-fit>: HTTP status code is not handled or not allowed
2026-01-10 17:57:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forced-air-circulation-incubator-programmable-256-liters-115-volt>: HTTP status code is not handled or not allowed
2026-01-10 17:57:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-digital-caliper-0-12-inch-0-300mm-range>: HTTP status code is not handled or not allowed
2026-01-10 17:57:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magnetic-v-block-3-0-inch-l-x-2-3-16-inch-w-x-3-0-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 17:57:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/styli-for-dial-test-indicators-1-8-inch-stem-dia->: HTTP status code is not handled or not allowed
2026-01-10 17:57:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pb-insulated-wax-glycerin-melting-heater-for-5-gallon-bucket-200-degrees>: HTTP status code is not handled or not allowed
2026-01-10 17:57:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-sidedshield-24-inch-reach-w-o-interlock-16-inch-l-x-14-inch-w-x-12-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 17:57:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shield-octagonal-24-inch-reach-w-o-interlock-handle-24-inch-l-x-10-inch-w-24-lb>: HTTP status code is not handled or not allowed
2026-01-10 17:57:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shield-octagonal-direct-mount-w-o-interlock-20-inch-l-x-10-inch-w>: HTTP status code is not handled or not allowed
2026-01-10 17:57:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shield-flat-direct-mount-w-interlock-led-16-inch-w-x-14-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 17:57:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ez-fit-hot-lid-dispenser-black-large-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 17:57:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ecp-heavy-duty-kit-for-5-8-inch-polyester-strap>: HTTP status code is not handled or not allowed
2026-01-10 17:57:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dura-spike-narrow-bird-spike-51l>: HTTP status code is not handled or not allowed
2026-01-10 17:57:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/birdslide-large-end-caps-beige-pair-of-5>: HTTP status code is not handled or not allowed
2026-01-10 17:57:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/synthetic-winch-line-w-integrated-shackle-916-dia-x-85l>: HTTP status code is not handled or not allowed
2026-01-10 17:57:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/synthetic-winch-line-w-integrated-shackle-916-dia-x-200l>: HTTP status code is not handled or not allowed
2026-01-10 17:57:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sj-18-inch-cordless-snow-blower-kit-48v-4-amp-hours>: HTTP status code is not handled or not allowed
2026-01-10 17:57:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbw-poly-bumper-truck-10-bushel-capacity-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:57:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/weldon-4-backless-picnic-bench-black>: HTTP status code is not handled or not allowed
2026-01-10 17:57:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/muskoka-adirondack-deck-dining-chair-40-12h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:57:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ridgecrest-pergola-120l-x-120w-coastal-teak>: HTTP status code is not handled or not allowed
2026-01-10 17:57:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/muskoka-adirondack-3-piece-bistro-dining-set-30h-table-whitewash>: HTTP status code is not handled or not allowed
2026-01-10 17:57:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/naples-gold-lines-slab-door-wood-36w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 17:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labella-slab-door-wood-24w-x-80h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-west-night-lines-slab-door-wood-32w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 17:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-largo-gold-lines-slab-door-wood-30w-x-80h-ice-maple>: HTTP status code is not handled or not allowed
2026-01-10 17:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sarasota-slab-door-wood-24w-x-80h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/largo-night-lines-slab-door-wood-24w-x-80h-ice-maple>: HTTP status code is not handled or not allowed
2026-01-10 17:58:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hog-heavenanti-fatigue-mat-58-thick-30l-x-3w-black-striped-border>: HTTP status code is not handled or not allowed
2026-01-10 17:58:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hog-heavenanti-fatigue-mat-78-thick-40l-x-5w-black>: HTTP status code is not handled or not allowed
2026-01-10 17:58:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergoforce-mens-waterproof-low-insulated-bib-overalls-xl-black>: HTTP status code is not handled or not allowed
2026-01-10 17:58:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-enhanced-visibility-softshell-insulated-bib-overalls-4xl-black>: HTTP status code is not handled or not allowed
2026-01-10 17:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5444 pages (at 92 pages/min), scraped 2283 items (at 36 items/min)
2026-01-10 17:58:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors>: HTTP status code is not handled or not allowed
2026-01-10 17:58:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors>: HTTP status code is not handled or not allowed
2026-01-10 17:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors>: HTTP status code is not handled or not allowed
2026-01-10 17:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors>: HTTP status code is not handled or not allowed
2026-01-10 17:58:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polarforce-mens-sweatshirt-3xl-black>: HTTP status code is not handled or not allowed
2026-01-10 17:58:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reflections-fork-silver-pack-of-320>: HTTP status code is not handled or not allowed
2026-01-10 17:58:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/renewable-compostable-sugarcane-plates-6-dia-natural-white-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 17:58:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mind-reader-coffee-pod-carousel-fits-30-pods-6-13-16-w-x-6-13-16-d-x-12-5-8-h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:58:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coated-paper-dinnerware-plate-9-dia-white-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:58:20 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-supplies/doors_windows/doors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-supplies/doors_windows/doors landed on page that is not a product page.
2026-01-10 17:58:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cold-cup-dome-lids-fits-16-24-oz-cups-pet-plastic-clear-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 17:58:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats>: HTTP status code is not handled or not allowed
2026-01-10 17:58:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats>: HTTP status code is not handled or not allowed
2026-01-10 17:58:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zero-calorie-sweetener-0-035-oz-pack-of-2000>: HTTP status code is not handled or not allowed
2026-01-10 17:58:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cake-container-9-shallow-9-dia-x-3-3-8-h-clear-black-pack-of-90>: HTTP status code is not handled or not allowed
2026-01-10 17:58:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/world-art-lids-for-12-oz-16-oz-32-oz-soup-container-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:58:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polystyrene-vented-hot-cup-lids-for-4-oz-cups-white-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 17:58:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colormaxx-paint-primer-12-oz-red-oxide-primer-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 17:58:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colormaxx-paint-primer-11-oz-metallic-gold-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 17:58:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colormaxx-paint-primer-12-oz-gloss-ivy-leaf-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 17:58:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delphi-x-observer-trinocular-microscope-for-anatomopathology>: HTTP status code is not handled or not allowed
2026-01-10 17:58:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glass-tube-patio-heater-40000-btu-propane-black>: HTTP status code is not handled or not allowed
2026-01-10 17:58:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hardwood_floor_stripping_polishing_cleaning_pad_chemical_package_17>: HTTP status code is not handled or not allowed
2026-01-10 17:58:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4200fc-marine-adhesive-sealant-295-ml-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 17:58:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-dining-set-36-in-round-x-29-in-h-table-4-chairs-black>: HTTP status code is not handled or not allowed
2026-01-10 17:58:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/water-tumbler-pitcher-set-32-oz-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 17:58:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carbon-fiber-rollator-w-comfort-seat-18-12w-x-24h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:58:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/padded-steel-drop-arm-commode-350-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:58:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/povidone-iodine-prep-solution-1-quart-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 17:58:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-deck-cart-stainless-steel-1200-lb-capacity-52-3-4l-x-30-1-8w-x-38-1-8h>: HTTP status code is not handled or not allowed
2026-01-10 17:58:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5th-wheel-garden-truck-steel-1200-lb-capacity-64-1-2l-x-36w-x-36-3-4h>: HTTP status code is not handled or not allowed
2026-01-10 17:58:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mesh-truck-w-1-adjustable-shelf-steel-2000-lb-cap-66-1-2l-x-26w-x-56-7-16h>: HTTP status code is not handled or not allowed
2026-01-10 17:58:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mesh-truck-w-1-adjustable-shelf-steel-2000-lb-cap-66-1-2l-x-32w-x-56-7-16h>: HTTP status code is not handled or not allowed
2026-01-10 17:58:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shower-diverter-stem-for-price-pfister-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 17:58:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-faucet-w-12-spout--soap-dish>: HTTP status code is not handled or not allowed
2026-01-10 17:58:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brass-shower-head-2-12-dia-18-gpm>: HTTP status code is not handled or not allowed
2026-01-10 17:58:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delta-repair-kit-for-ball-style-for-ball-style-lever-handle-faucets-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 17:58:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vl500-75-ergo-wet-dry-vacuum-cleaner-19-gallon-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:58:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rope-hanger-14l-x-2-12w-x-10-12h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_bookcases_hutches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/business-furniture-l-shaped-table-desk-w-3-drawers-71w-x-77-3-8d-x-29-7-8h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:58:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/business-furniture-coventry-u-shaped-sectional-couch-113w-x-87d-x-35-3-4h-beige>: HTTP status code is not handled or not allowed
2026-01-10 17:58:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beverage-center-1-glass-door-31-cuft-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:58:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apartment-size-refrigerator-11-cuft-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 17:58:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/-gymshoe-sport-floor-finish-f-style-w-catalyst-1-gallon-bottle-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 17:58:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/organizer-cabinet-assembled-24w-x-18d-x-72h-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/counter_height_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 17:58:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/organizer-cabinet-assembled-24w-x-18d-x-72h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:58:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-w-drawer--shelves-assembled-30w-x-18d-x-72h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:59:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bookcase-assembled-36w-x-18d-x-45h-hunter-green>: HTTP status code is not handled or not allowed
2026-01-10 17:59:01 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_bookcases_hutches> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_bookcases_hutches landed on page that is not a product page.
2026-01-10 17:59:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/loadwell-gel-loading-pipette-tips-sterile-pack-of-960>: HTTP status code is not handled or not allowed
2026-01-10 17:59:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sterile-sampling-bag-27-oz-capacity-11-1516l-x-4-12w-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:59:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teardrop-pallet-rack-starter-108-in-w-x-24-in-d-x-120-in-h>: HTTP status code is not handled or not allowed
2026-01-10 17:59:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterproof-parka-jacket-w-fleece-lining-class-3-lime-large>: HTTP status code is not handled or not allowed
2026-01-10 17:59:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-quilted-jacket-w-removable-hood-class-3-lime-2xl>: HTTP status code is not handled or not allowed
2026-01-10 17:59:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-diamond-quilted-jacket-w-removable-hood-black-2xl>: HTTP status code is not handled or not allowed
2026-01-10 17:59:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/cabinets/counter_height_cabinets>: HTTP status code is not handled or not allowed
2026-01-10 17:59:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diy-4th-gen-e-star-ductless-mini-split-heat-pump-24000-btu-205-seer-208-230v>: HTTP status code is not handled or not allowed
2026-01-10 17:59:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-truck-w-rigid--swivel-casters-3600-lb-cap-48l-x-24w-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:59:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5537 pages (at 93 pages/min), scraped 2319 items (at 36 items/min)
2026-01-10 17:59:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forkliftable-truck-w-2-shelves-3600-lb-cap-53-12l-x-30w-x-69h-gray>: HTTP status code is not handled or not allowed
2026-01-10 17:59:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-class-2-hi-vis-safety-vest-2-pockets-mesh-lime-l-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:59:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-class-2-hi-vis-safety-vest-2-reflective-strips-poly-mesh-lime-l-xl>: HTTP status code is not handled or not allowed
2026-01-10 17:59:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chill-its-6667-wet-evaporative-cooling-vest-pva-zipper-4xl-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:59:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8377ev-winter-bomber-jacket-enhanced-visibility-large-black>: HTTP status code is not handled or not allowed
2026-01-10 17:59:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8373-hi-vis-hooded-sweatshirt-black-bottom-class-3-3xl-lime>: HTTP status code is not handled or not allowed
2026-01-10 17:59:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-7001-abrasion-resistant-gloves-nitrile-coated-s-black-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 17:59:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-7000-nitrile-coated-gloves-w-microfoam-palm-xl-gray-12-pairs>: HTTP status code is not handled or not allowed
2026-01-10 17:59:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-7024-cut-resistant-gloves-polyurethane-coated-ansi-a2-2xl-blue-12-pairs>: HTTP status code is not handled or not allowed
2026-01-10 17:59:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iqv-20-lithium-ion-battery-20v-25-ah-extended-capacity>: HTTP status code is not handled or not allowed
2026-01-10 17:59:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-tier-4-door-digital-locker-12in-w-x-18in-d-x-78in-h-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 17:59:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-tier-3-door-digital-locker-12in-w-x-15in-d-x-78in-h-tan-assembled>: HTTP status code is not handled or not allowed
2026-01-10 17:59:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protective-hat-fas-trac-iii-suspension-white>: HTTP status code is not handled or not allowed
2026-01-10 17:59:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/km-130300-r-lpg-ride-on-battery-sweeper-w-1-side-brush-51-cleaning-width>: HTTP status code is not handled or not allowed
2026-01-10 17:59:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/procedure-phlebotomy-stat-cart-w-6-drawers-23l-x-26-14w-x-47-h-white>: HTTP status code is not handled or not allowed
2026-01-10 17:59:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-kit-for-w-650ic>: HTTP status code is not handled or not allowed
2026-01-10 17:59:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-kit-for-kf-450f>: HTTP status code is not handled or not allowed
2026-01-10 17:59:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-rubber-for-w-500l>: HTTP status code is not handled or not allowed
2026-01-10 17:59:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-convex-mirror-w-stainless-steel-backer-outdoor-34-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:59:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shatter-resistant-round-convex-mirror-glass-outdoor-18-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:59:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tough-coat-adv-spray-paint-w-rust-barrier-tech-20-oz-cap-gloss-equipment-yellow>: HTTP status code is not handled or not allowed
2026-01-10 17:59:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-shaped-bur-double-cut-2-116l-x-14-shank-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:59:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-shaped-bur-for-stainless-steel-2-12l-x-14-shank-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:59:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/radius-tree-shaped-bur-single-cut-3l-x-14-shank-dia>: HTTP status code is not handled or not allowed
2026-01-10 17:59:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-pouch-w-snap-for-bur-sets-blue>: HTTP status code is not handled or not allowed
2026-01-10 17:59:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bur-box-diamond-cut-sa5-sc3-sc5-sd5-sf3-sf5-sg3-sl4-set-of-8>: HTTP status code is not handled or not allowed
2026-01-10 17:59:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blender-bag-400mlx70m-w-full-nylon-filter-300x190mm-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 17:59:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/block-for-one-deep-well-micro-plate>: HTTP status code is not handled or not allowed
2026-01-10 17:59:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/voyager-rechargeable-led-work-light-w-tripod-8000-lumens-black>: HTTP status code is not handled or not allowed
2026-01-10 17:59:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sentrysafe-tray-insert-accessory-for-08-12-cubic-feet-safes>: HTTP status code is not handled or not allowed
2026-01-10 17:59:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala174-sealed-blok-self-retracting-lifeline-w-bracket-steel-cable-360l>: HTTP status code is not handled or not allowed
2026-01-10 17:59:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-nano-lok-personal-self-retracting-lifeline-w-rebar-hook-2726-lb-wt-72l>: HTTP status code is not handled or not allowed
2026-01-10 17:59:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-sided-starter-36l-x-14w-x-54h-antique-white>: HTTP status code is not handled or not allowed
2026-01-10 17:59:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-sided-starter-36l-x-18w-x-72h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:59:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-add-on-48l-x-28w-x-54h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:59:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-starter-36l-x-28w-x-96h-black>: HTTP status code is not handled or not allowed
2026-01-10 17:59:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-starter-48l-x-28w-x-96h-antique-white>: HTTP status code is not handled or not allowed
2026-01-10 17:59:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/noneal36cl-ao-v-tec-mini-personal-fall-limiter-single-leg-6l>: HTTP status code is not handled or not allowed
2026-01-10 17:59:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v-gard-h1pro-safety-helmet-non-vented-fas-trac-iii-pivot-ratchet-suspension-white>: HTTP status code is not handled or not allowed
2026-01-10 17:59:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/marque-quad-unit-reception-curved-desk-workstation-142w-x-103d-x-45-12h-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 17:59:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-padded-lightweight-knee-sleeves-lxl-black>: HTTP status code is not handled or not allowed
2026-01-10 17:59:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/none36c-ao-v-tec-mini-personal-fall-limiter-single-leg-6l>: HTTP status code is not handled or not allowed
2026-01-10 17:59:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mmb-yb9a-a-12v-9ah-130cca-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:00:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz-aegir-afasm-half-frame-safety-glasses-blue-mirror-lens-lime-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:00:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz-aegir-afasm-half-frame-safety-glasses-orange-mirror-lens-clear-smoke-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:00:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-flex-ii-vinyl-bulk-roll-anti-static-smooth-12-x-0120-x-150-light-green>: HTTP status code is not handled or not allowed
2026-01-10 18:00:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/array153-lookout-wall-mount-display-desktop-120v-ac-white>: HTTP status code is not handled or not allowed
2026-01-10 18:00:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apex-digital-clinical-scale-600-lb-cap-17l-x-17w-platform>: HTTP status code is not handled or not allowed
2026-01-10 18:00:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-2-bar-steel-ladder-roof-rack-for-nissan-nv-cargo-van-2011-on-white>: HTTP status code is not handled or not allowed
2026-01-10 18:00:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-3-bar-steel-ladder-roof-rack-for-nissan-nv200-2013-on-black>: HTTP status code is not handled or not allowed
2026-01-10 18:00:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-3-bar-aluminum-ladder-rack-system-for-gmc-savana-1996-on-black>: HTTP status code is not handled or not allowed
2026-01-10 18:00:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5636 pages (at 99 pages/min), scraped 2367 items (at 48 items/min)
2026-01-10 18:00:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/light-duty-conveyor-netting-w-debris-liner-1146-lb-capacity-300l-x-108w-black>: HTTP status code is not handled or not allowed
2026-01-10 18:00:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60a36x1-a-plate-34-pitch-1-bore-36-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-20a45-metric-a-plate-1-14-pitch-32mm-bore-45-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs11hx38-metric-1-12-pitch-38mm-finished-bore-11-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs34x158-1-pitch-1-58-finished-bore-34-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-safety-crafted-waterproof-logger-work-boots-steel-toe-size-10-5m-8-inch-h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:00:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-16a26-metric-1-pitch-30mm-bore-26-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs28hx1-34-pitch-1-finished-bore-28-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-08bs18hx25-metric-12-pitch-25mm-finished-bore-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:00:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-and-mild-foam-handwash-refill-for-ltx-12-dispenser-fragrance-free-1200-ml>: HTTP status code is not handled or not allowed
2026-01-10 18:00:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs47x1716-34-pitch-1-716-finished-bore-47-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs14hx32-metric-1-12-pitch-32mm-finished-bore-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs16hx42-metric-1-12-pitch-42mm-finished-bore-16-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs14hx35-metric-1-12-pitch-35mm-finished-bore-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:00:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-safety-crafted-waterproof-logger-work-boots-steel-toe-size-6-5m-8-inch-h-dark-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:00:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-safety-crafted-waterproof-work-boots-steel-toe-size-10m-6-inch-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:00:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs32x21516-1-pitch-2-1516-finished-bore-32-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steri-drape-laparoscopy-drape-1032-95-inch-4-tube-organizer-8-bx-2-bx-cs>: HTTP status code is not handled or not allowed
2026-01-10 18:00:30 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots landed on page that is not a product page.
2026-01-10 18:00:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/groundbreaker-work-boots-w-internal-met-guard-steel-toe-size-6w-6-inch-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:00:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100b18hx114mpb-1-14-pitch-1-14-plain-bore-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-high-top-sneaker-composite-toe-size-8-5w-black-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:00:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100bs25hx114-1-14-pitch-1-14-finished-bore-25-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots>: HTTP status code is not handled or not allowed
2026-01-10 18:00:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots>: HTTP status code is not handled or not allowed
2026-01-10 18:00:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steri-drape-2-incise-drape-2045-incise-area-19-5-8-inch-x-17-5-8-inch-10-carton-4-cartons-case>: HTTP status code is not handled or not allowed
2026-01-10 18:00:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/groundbreaker-work-boots-w-external-met-guard-steel-toe-size-10-5w-8-inch-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:00:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bair-hugger-warming-gown-81101-small-44-inch-l-20-case>: HTTP status code is not handled or not allowed
2026-01-10 18:00:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-men-s-low-cut-sneaker-composite-toe-size-16m-black-red>: HTTP status code is not handled or not allowed
2026-01-10 18:00:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-men-s-low-cut-sneaker-composite-toe-size-15w-black-red>: HTTP status code is not handled or not allowed
2026-01-10 18:00:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-men-s-low-cut-sneaker-composite-toe-size-11w-black>: HTTP status code is not handled or not allowed
2026-01-10 18:00:43 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 18:00:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-silicone-nosepiece-adapter-for-electronic-pipette-controller>: HTTP status code is not handled or not allowed
2026-01-10 18:00:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vitals-skate-inspired-work-shoes-composite-toe-size-10-5m-wintermoss-whitecap-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:00:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs36x1316-1-pitch-1-316-finished-bore-36-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-centrifuge-tubes-with-8-bags-of-25-tubes-sterile-25-ml-200-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:00:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50btl18h-taper-bushed-58-pitch-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:00:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truflex-fly-skylar-sneaker-composite-toe-size-7-5w-black>: HTTP status code is not handled or not allowed
2026-01-10 18:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:00:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-reservoir-for-multi-channel-pipettes-sterile-25-ml-200-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:00:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/true-skate-inspired-work-shoes-composite-toe-size-13m-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:00:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-mx-z-600-ho-594cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:00:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs25hx34-38-pitch-34-finished-bore-25-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:00:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 18:00:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truflex-fly-blucher-sneaker-composite-toe-size-12m-black-gold>: HTTP status code is not handled or not allowed
2026-01-10 18:00:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-skate-inspired-work-shoes-composite-toe-size-14m-blue-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:00:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 18:01:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 18:01:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerware-bat-0370-ups-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:01:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-41b16hx58mpb-12-pitch-58-plain-bore-16-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs12hx1-34-pitch-1-finished-bore-12-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/philips-m17-medical-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:01:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/philips-h102-medical-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:01:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-10bs18hx42-metric-58-pitch-42mm-finished-bore-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:01:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60a20hx34-a-plate-34-pitch-34-bore-20-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-skate-inspired-work-shoes-composite-toe-size-7w-blue-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:01:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5727 pages (at 91 pages/min), scraped 2403 items (at 36 items/min)
2026-01-10 18:01:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rolls-18-x-200-yards>: HTTP status code is not handled or not allowed
2026-01-10 18:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:01:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/philips-a212-28g6-medical-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:01:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/philips-str112053-medical-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:01:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-10bs18hx40-metric-58-pitch-40mm-finished-bore-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-bags-6-x-9-2-mil-red-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:01:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caterpillar-112-industrial-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:01:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 18:01:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanoflex-tr-athletic-work-shoes-composite-toe-size-9m-black-camo-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:01:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 18:01:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 18:01:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40bs24hx1716-12-pitch-1-716-finished-bore-24-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100sds11h-qd-bushed-1-14-pitch-11-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permanent-roof-anchor-with-d-ring-connection>: HTTP status code is not handled or not allowed
2026-01-10 18:01:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/construction-harness-tongue-buckle-legs-small>: HTTP status code is not handled or not allowed
2026-01-10 18:01:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs22hx118-58-pitch-1-18-finished-bore-22-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:01:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rb3315-nanoflex-tr-athletic-work-shoes-composite-toe-size-12m-black>: HTTP status code is not handled or not allowed
2026-01-10 18:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:01:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanoflex-tr-athletic-work-shoes-composite-toe-size-11w-black-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:01:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-inch-w-x-30-inch-d-extra-long-production-workbench-shop-top-square-edge-gray-318913>: HTTP status code is not handled or not allowed
2026-01-10 18:01:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pearl-eraser-medium-24-bx-pink>: HTTP status code is not handled or not allowed
2026-01-10 18:01:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs20hx1716-58-pitch-1-716-finished-bore-20-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/975-electric-hydraulic-pump>: HTTP status code is not handled or not allowed
2026-01-10 18:01:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hk520-hydraulic-acsr-cable-cutter>: HTTP status code is not handled or not allowed
2026-01-10 18:01:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-w-x-30-d-pedestal-workbench-w-double-cabinet-esd-laminate-sqaure-edge-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:01:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs09hx58-34-pitch-58-finished-bore-9-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:36 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 18:01:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultratech-ut12180-alarm-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:01:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-10m-black>: HTTP status code is not handled or not allowed
2026-01-10 18:01:38 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 18:01:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-smp5pmp16-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:01:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simplex-20819276-alarm-replacement-battery-1-3ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:01:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exam-table-paper-deluxe-crepe-21-x-125-ft-white-12-rollscarton>: HTTP status code is not handled or not allowed
2026-01-10 18:01:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fer-hg9330-patio-coqver-10-ft-l-x-30-ft-w-white>: HTTP status code is not handled or not allowed
2026-01-10 18:01:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chloride-power-d2mf50-alarm-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:01:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-7m-gray-black>: HTTP status code is not handled or not allowed
2026-01-10 18:01:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lavante-trail-2-running-work-shoes-composite-toe-size-8-5w-gray-red-black>: HTTP status code is not handled or not allowed
2026-01-10 18:01:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lavante-trail-2-running-work-shoes-composite-toe-size-13w-army-green-black-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:01:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hook-n-loop-tape-fasteners-orange-3-8-inch-x-75-feet>: HTTP status code is not handled or not allowed
2026-01-10 18:01:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merits-mpii-a-wheelchair-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:01:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acme-rb6-home-alarm-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:01:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bruno-club-35-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:01:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lavante-trail-2-running-work-shoes-composite-toe-size-14w-gray-red-black>: HTTP status code is not handled or not allowed
2026-01-10 18:01:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quickie-p-220-wheelchair-replacement-battery-75ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:01:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-25a35x38-a-plate-14-pitch-38-bore-35-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs12hx58-38-pitch-58-finished-bore-12-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-14w-silver-gray-clay-black>: HTTP status code is not handled or not allowed
2026-01-10 18:01:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs17hx1-38-pitch-1-finished-bore-17-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/foodservice_carts/pan_carriers_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:01:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/09824-lid-polycarbonate-12-size-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:02:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-25b14hx14mpb-14-pitch-14-plain-bore-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:02:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/column-protector-12x-12-square-opening-with-fe-cutout-24od-x-42h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:02:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-high-top-work-shoes-composite-toe-size-6-5m-triple-black>: HTTP status code is not handled or not allowed
2026-01-10 18:02:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extreme-softshell-jacket-black-60f-comfort-rating-xl>: HTTP status code is not handled or not allowed
2026-01-10 18:02:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/can-am-quest-opt-650cc-atv-replacement-battery-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 18:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:02:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-black-widow-boots-15f-comfort-rating-size-8-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 18:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:02:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-tapered-roller-bearing-e32007j-35mm-bore-62mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:02:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/foodservice_carts/pan_carriers_racks>: HTTP status code is not handled or not allowed
2026-01-10 18:02:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5820 pages (at 93 pages/min), scraped 2440 items (at 37 items/min)
2026-01-10 18:02:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elan-vgl68-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:02:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/winch-strap-423040-with-chain-anchor-30-x-4-gold>: HTTP status code is not handled or not allowed
2026-01-10 18:02:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-tapered-roller-bearing-e30214j-70mm-bore-125mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:02:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/epdm-synthetic-rubber-tarp-tie-2231epdm-31-50-pieces-per-box>: HTTP status code is not handled or not allowed
2026-01-10 18:02:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-work-shoes-composite-toe-size-9-5w-olive-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:02:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-high-top-work-shoes-composite-toe-size-10w-triple-black>: HTTP status code is not handled or not allowed
2026-01-10 18:02:16 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 18:02:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats>: HTTP status code is not handled or not allowed
2026-01-10 18:02:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 18:02:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lu621-food-grade-anti-seize-compound>: HTTP status code is not handled or not allowed
2026-01-10 18:02:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honeywell-steam-vaporstat-controller-wgrounding-screw-l408j1017-14-female-15-psi-max>: HTTP status code is not handled or not allowed
2026-01-10 18:02:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cc-pump-motor-wwe2-36-145jp-tefc-rigid-c-3-ph-145jp-2-hp-3600-rpm>: HTTP status code is not handled or not allowed
2026-01-10 18:02:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interstate-faytz14s-powersports-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:02:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bb4500-high-top-work-sneaker-composite-toe-size-8-5m-black-white>: HTTP status code is not handled or not allowed
2026-01-10 18:02:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerstar-pm30l-bs-powersports-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:02:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bb4500-high-top-work-sneaker-composite-toe-size-7m-black-white>: HTTP status code is not handled or not allowed
2026-01-10 18:02:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extreme-xta14ah-bs-powersports-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:02:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-frame-motor-wwht60-18-364tc-gp-tefc-rigid-c-3-ph-364tc-705-fla>: HTTP status code is not handled or not allowed
2026-01-10 18:02:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extreme-xta20hl-bs-powersports-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:02:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rack-enclosure-cabinet-fan-panel-airflow-management-120v-3urm-srfan3u>: HTTP status code is not handled or not allowed
2026-01-10 18:02:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rack-enclosure-cabinet-cantilever-fixed-shelf-60lb-capacity-2urm-srshelf2p>: HTTP status code is not handled or not allowed
2026-01-10 18:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:02:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss-washdown-duty-motor-wss13-18-56crd-tefc-round-c-3-ph-1-3-hp-1800-rpm>: HTTP status code is not handled or not allowed
2026-01-10 18:02:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bb4500-high-top-work-sneaker-composite-toe-size-11m-black-white>: HTTP status code is not handled or not allowed
2026-01-10 18:02:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/retractable-gel-pens-black-ink-black-barrel-1-each-bl407aa>: HTTP status code is not handled or not allowed
2026-01-10 18:02:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ozbike-all-motorcycle-replacement-battery-1966-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:02:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/291-industrial-carton-sealing-tape-2-x-55-yds-clear-pack-of-36>: HTTP status code is not handled or not allowed
2026-01-10 18:02:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-frame-motor-wwht150-12-445-7t-gp-tefc-rigid-3-ph-445-7t-171-fla-rb>: HTTP status code is not handled or not allowed
2026-01-10 18:02:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bf-161sl-hole-filler-plate-258dia-silver-coated>: HTTP status code is not handled or not allowed
2026-01-10 18:02:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cc-pump-motor-wwe10-36-215jp-tefc-rigid-c-3-ph-215jp-10-hp-3600-rpm>: HTTP status code is not handled or not allowed
2026-01-10 18:02:37 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 18:02:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arctic-cat-zr-500-cc-497cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:02:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-gsx-550f-550cc-snowmobile-replacement-battery-2005-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:02:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steam-outlet-cleaning-tool-for-mr-50-steam-vacuum-261576>: HTTP status code is not handled or not allowed
2026-01-10 18:02:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rais-n-rol-machinery-mover-w-5-polyurethane-casters-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:02:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10pk-rj45-plugs-solid-stranded-conductor-4-pair-cat5e-cat5-cable>: HTTP status code is not handled or not allowed
2026-01-10 18:02:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apc-smartups-750va-usb-sua750-ups-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:02:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-port-rugged-industrial-usb-20-hi-speed-hub-15kv-esd-immunity>: HTTP status code is not handled or not allowed
2026-01-10 18:02:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/concealed-frame-access-panel-for-wallboard-lock-18l-x-18w>: HTTP status code is not handled or not allowed
2026-01-10 18:02:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mark-bracket-for-wall-mounting-of-fire-extinguisher-for-model-galaxy-5-12-mercury-5-cosmic-5>: HTTP status code is not handled or not allowed
2026-01-10 18:02:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/600-economy-carton-sealing-tape-2-x-110-yds-clear-pack-of-36>: HTTP status code is not handled or not allowed
2026-01-10 18:02:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amstar-ams2000led-jump-starter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:02:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-prescolite-em-exit-6v-4-5ah-emergency-light-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:02:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digitech-safety-view-plus-4-tier-4-doors-box-locker-12w-x-18d-x-78h-tan-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 18:02:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jump-n-carry-jnc105-jump-starter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:02:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/55-gal-yellow-plastic-open-head-tapered-drum-plastic-lever-lock-987225>: HTTP status code is not handled or not allowed
2026-01-10 18:02:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-built-ii153-1-tier-1-door-locker-12w-x-15d-x-83h-light-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 18:02:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-built153-2-tier-6-doors-locker-36w-x-18d-x-78h-black-assembled>: HTTP status code is not handled or not allowed
2026-01-10 18:02:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-primer-for-antislip-coatings-1-gal-mp-gl>: HTTP status code is not handled or not allowed
2026-01-10 18:02:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shotgun-storage-case-3842-sa-blk-1-gun-capacity-8w-x-3-12d-x-42h-semi-flat-black>: HTTP status code is not handled or not allowed
2026-01-10 18:02:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bigboy-folding-saw-360mm-medium-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/boards_easels/dry_erase_whiteboards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:03:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-post-safety-barrier-15-ft-yellow-belt>: HTTP status code is not handled or not allowed
2026-01-10 18:03:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topin-tp12-7-sealed-lead-acid-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:03:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-closed-stand-alone-shelving-8-shelves-500-lb-cap-36w-x-18d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:03:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-waterfall-deck-shelving-5-shelves-72w-x-24d-x-84h-midnight-ebony>: HTTP status code is not handled or not allowed
2026-01-10 18:03:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mk-es14-12-sealed-lead-acid-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:03:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-built153-6-tier-6-doors-locker-12w-x-15d-x-78h-light-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 18:03:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calm90-opc-output-cover-for-calm-series-90mm-aluminum-worm-gear-reducer>: HTTP status code is not handled or not allowed
2026-01-10 18:03:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calm75-ta-torque-arm-for-calm-series-75mm-aluminum-worm-gear-reducer>: HTTP status code is not handled or not allowed
2026-01-10 18:03:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 5919 pages (at 99 pages/min), scraped 2482 items (at 42 items/min)
2026-01-10 18:03:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/see-thru-sensory-table-toddler>: HTTP status code is not handled or not allowed
2026-01-10 18:03:10 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/boards_easels/dry_erase_whiteboards> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/boards_easels/dry_erase_whiteboards landed on page that is not a product page.
2026-01-10 18:03:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/csb-gpl-1272-sealed-lead-acid-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:03:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ritar-rt12120h-sealed-lead-acid-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:03:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eco-flo-ecd33w-submersible-sump-pump-cast-iron>: HTTP status code is not handled or not allowed
2026-01-10 18:03:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jerry-can-w-spout-adapter-red-5-liter-3015>: HTTP status code is not handled or not allowed
2026-01-10 18:03:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/close-style-deep-bin-shelving-7-shelves-starter-unit-36w-x-48d-x-87h-bluegray>: HTTP status code is not handled or not allowed
2026-01-10 18:03:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-in-x-12-in-steel-door-louver>: HTTP status code is not handled or not allowed
2026-01-10 18:03:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/34-in-backdraft-damper>: HTTP status code is not handled or not allowed
2026-01-10 18:03:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yuasa-np1812b-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:03:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stair-tread-rubber-square-nose-48l-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 18:03:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yuasa-rew45-12-rew-45-12-12v-9ah-ups-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:03:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-lpx12-24-sealed-lead-acid-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:03:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cove-base-vinyl-4x080x48-black>: HTTP status code is not handled or not allowed
2026-01-10 18:03:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-track-weld-on-contoured-single-strap-anchor-zinc-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 18:03:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-track-tie-down-hook-ring-adapter-for-hook-straps-rope-cable>: HTTP status code is not handled or not allowed
2026-01-10 18:03:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-house-650net-12v-45ah-ups-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:03:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/13-32-inch-jobbers-length-drill-blank>: HTTP status code is not handled or not allowed
2026-01-10 18:03:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/work-height-platform-truck-rnh2-2448-6mr-ah-with-lower-shelf-24-x-48-adj-height>: HTTP status code is not handled or not allowed
2026-01-10 18:03:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uniwell-sla0955-sealed-lead-acid-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:03:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-in-black-malleable-union-150-psi-lead-free>: HTTP status code is not handled or not allowed
2026-01-10 18:03:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extinguisher-cabinet-full-tempered-safety-glass-ss-surface-mt-11-1-2-inch-l-x-26-1-2-inch-h-x-5-3-4-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 18:03:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-mobility-230-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:03:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-in-6-in-black-steel-pipe-nipple-150-psi-lead-free>: HTTP status code is not handled or not allowed
2026-01-10 18:03:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-2-in-4-1-2-in-black-steel-pipe-nipple-150-psi-lead-free>: HTTP status code is not handled or not allowed
2026-01-10 18:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/plumbing/plumbing_fittings/pipe_clamps_fittings/galvanized_malleable_pipe_fittings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:03:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-smp10pm24p4cb-alarm-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:03:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ge-caddx-networx-nx-6-alarm-replacement-battery-4-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/storage_panels/pegboards_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:03:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-cable-assembly-14dia-x-90-l>: HTTP status code is not handled or not allowed
2026-01-10 18:03:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stretcher-sheet-disposable-72l-x-40w-50bx-poly-tissue-bl>: HTTP status code is not handled or not allowed
2026-01-10 18:03:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dyno-lever-hoist-3-ton-capacity-5-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:03:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ibmotrin-pain-reliever-50-bx>: HTTP status code is not handled or not allowed
2026-01-10 18:03:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powervar-abce1100-11iec-12v-10ah-ups-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:03:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carboy-autoclavable-pp-20-liter-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 18:03:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powervar-abce420-11-800va-12v-7ah-ups-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:03:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/time-cards-for-bx-1500-bi-weekly-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:03:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-ribbon-for-mjr-7000-time-clock>: HTTP status code is not handled or not allowed
2026-01-10 18:03:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-i-steel-safety-can-2-5-gallon-9-5l-self-close-lid-blue-7125300>: HTTP status code is not handled or not allowed
2026-01-10 18:03:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/plumbing/plumbing_fittings/pipe_clamps_fittings/galvanized_malleable_pipe_fittings>: HTTP status code is not handled or not allowed
2026-01-10 18:03:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wardrobe-z-locker-w-padlock-hasp-2-tier-assembled-18w-x-18d-x-72h-deep-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:03:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desiccator-vacuum-white-base-polypropylenepolycarbonate-6-dia>: HTTP status code is not handled or not allowed
2026-01-10 18:03:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desiccator-glass-6-dia>: HTTP status code is not handled or not allowed
2026-01-10 18:03:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/storage_panels/pegboards_accessories>: HTTP status code is not handled or not allowed
2026-01-10 18:03:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tensacone-yellow-75-ft-black-yellow-chevron-belt>: HTTP status code is not handled or not allowed
2026-01-10 18:03:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/63182rs-deep-groove-ball-bearing-double-sealed-90mm-bore-190mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:03:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pink-plastic-shim-coil-015-5-20>: HTTP status code is not handled or not allowed
2026-01-10 18:03:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6226zz-deep-groove-ball-bearing-double-shielded-130mm-bore-230mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:03:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reagent-bottle-narrow-mouth-hdpe-30ml-capacity-amber-pack-of-72>: HTTP status code is not handled or not allowed
2026-01-10 18:03:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combination-shower-floor-mount-closed-abs-bowl-galvanized-steel-pipe-bottom-inlet>: HTTP status code is not handled or not allowed
2026-01-10 18:03:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-clamp-6-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:03:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6208zznr-deep-groove-ball-bearing-double-shielded-snap-ring-40mm-bore-80mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:03:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/32210-tapered-roller-bearing-metric-50mm-bore-90mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:04:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wardrobe-locker-w-padlock-hasp-3-tier-assembled-12w-x-12d-x-60h-beige>: HTTP status code is not handled or not allowed
2026-01-10 18:04:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reagent-bottle-narrow-mouth-pp-500ml-capacity-clear-pack-of-125>: HTTP status code is not handled or not allowed
2026-01-10 18:04:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6315zz-deep-groove-ball-bearing-double-shielded-75mm-bore-160mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:04:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leisure-lift-pediatric-wheelchair-replacement-battery-5ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:04:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-rehab-salsa-m2-wheelchair-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:04:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-electric-vibrator-mve-050-dc-12-3000rpm-single-phase-12v-dc>: HTTP status code is not handled or not allowed
2026-01-10 18:04:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/access-point-axs8000-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:04:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teardrop-bolted-pallet-rack-add-on-144w-x-36d-x-96h>: HTTP status code is not handled or not allowed
2026-01-10 18:04:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-aerator-aluminum-shaft-with-silicon-lip-micro>: HTTP status code is not handled or not allowed
2026-01-10 18:04:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/622102rs-deep-groove-ball-bearing-wide-width-double-sealed-50mm-bore-90mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:04:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merits-p12012-tbmu-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:04:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6305-deep-groove-ball-bearing-open-25mm-bore-62mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:04:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6014 pages (at 95 pages/min), scraped 2514 items (at 32 items/min)
2026-01-10 18:04:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/damaco-childs-elite-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:04:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6003zz-deep-groove-ball-bearing-double-shielded-17mm-bore-35mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:04:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ariens-st-1336-lawn-and-garden-replacement-battery-8ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:04:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62092rs-deep-groove-ball-bearing-double-sealed-45mm-bore-85mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:04:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toro-269-h-lawn-and-garden-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:04:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-w-x-30-d-standing-height-workbench-plastic-laminate-square-edge-black>: HTTP status code is not handled or not allowed
2026-01-10 18:04:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-72l-x-24w-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:04:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-30l-x-14w-x-60h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:04:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brite-liner-highlighter-with-pocket-clip-chisel-tip-assorted-inks-5set>: HTTP status code is not handled or not allowed
2026-01-10 18:04:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-54l-x-24w-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:04:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/john-deere-650-lawn-and-garden-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:04:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-48l-x-24w-x-80h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:04:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-24l-x-21w-x-69h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:04:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mki-xts01z-18v-3-8-crown-stapler-bare-tool>: HTTP status code is not handled or not allowed
2026-01-10 18:04:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bisley-x--back-womens-long-sleeve-shirt-class-3-2xl-hi-vis-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:04:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunworks-construction-paper-12x18-yellow-50-sheets>: HTTP status code is not handled or not allowed
2026-01-10 18:04:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bisley-womens-long-sleeve-shirt-l-hi-vis-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:04:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunworks-smart-stack-construction-paper-12x18-assorted-150-sheets>: HTTP status code is not handled or not allowed
2026-01-10 18:04:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modern-equipment-meco-3s2448-1r-b-3-sided-steel-mesh-service-truck-48x24-1-shelf-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:04:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8020-25-series-1-x-1-116-bi--quarter-t-slotted-extrusion-profile-118-18l-stock-bar>: HTTP status code is not handled or not allowed
2026-01-10 18:04:31 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers landed on page that is not a product page.
2026-01-10 18:04:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bisley-airflow153-womens-long-sleeve-shirt-class-2-m-hi-vis-yellownavy>: HTTP status code is not handled or not allowed
2026-01-10 18:04:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frixion-light-erasable-highlighter-chisel-tip-orangepinkyellow-ink-3pack>: HTTP status code is not handled or not allowed
2026-01-10 18:04:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8020-40-series-1-916-x-3-18-lite-six-t-slotted-extrusion-profile-238-316l-stock-bar>: HTTP status code is not handled or not allowed
2026-01-10 18:04:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g301-gel-retractable-pen-07mm-stainless-steel-barrel-black-ink-1-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:04:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/46-square-ada-in-ground-mount-picnic-table-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:04:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zgrip-ballpoint-retractable-pen-10mm-black-ink-dozen>: HTTP status code is not handled or not allowed
2026-01-10 18:04:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-ton-single-acting-cylinder-h0509-9-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:04:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rsvp-ballpoint-stick-pen-medium-clear-barrel-black-ink-dozen>: HTTP status code is not handled or not allowed
2026-01-10 18:04:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ans25mdr-25-watt-audio-notification-panel-red>: HTTP status code is not handled or not allowed
2026-01-10 18:04:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lithonia-aqm-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:04:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hyperlite-extension-ladder-w-cable-hooks-ratchet-leveler-32-type-iaa-375-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:04:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hyperlite-extension-ladder-w-v-rung-ratchet-levelers-20-type-iaa-375-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:04:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hubbell-12-800-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:04:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6x3-8-dralon-woven-mini-roller-w-14-frame-12-case-614-wv038>: HTTP status code is not handled or not allowed
2026-01-10 18:04:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4x1-2-acrylic-mini-roller-cover-12-pack-8-case-4cr050q-12>: HTTP status code is not handled or not allowed
2026-01-10 18:04:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/louisville-8-type-1aa-fiberglass-pro-platform-step-ladder-fxp1808hd>: HTTP status code is not handled or not allowed
2026-01-10 18:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/ladders_personnel_lifts/step_ladders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:04:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sure-lites-263-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:04:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sure-lites-r6c-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:04:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-12v-5ah-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:04:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-6-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:04:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-work-light-sl520-25l-cord-182-ga-black-6pk>: HTTP status code is not handled or not allowed
2026-01-10 18:04:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bb-bp76-t1-6v-7ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:04:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-metal-cage-for-trouble-light-sl1006-6pk>: HTTP status code is not handled or not allowed
2026-01-10 18:04:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-9-emergency-light-replacement-battery-8ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:04:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/material-handling/ladders_personnel_lifts/step_ladders>: HTTP status code is not handled or not allowed
2026-01-10 18:05:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clip-bin-front-48-inch-w-x-3-inch-h-jet-black>: HTTP status code is not handled or not allowed
2026-01-10 18:05:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-stage-air-compressor-w-intek-engine-10-hp-30-gallon-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:05:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qp-max-two-stage-air-compressor-vertical-5-hp-80-gallon-capacity-3-phase-460v>: HTTP status code is not handled or not allowed
2026-01-10 18:05:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qp-two-stage-splash-lubricated-air-compressor-175-psi-14-hp-30-gallon-capacity-horizontal>: HTTP status code is not handled or not allowed
2026-01-10 18:05:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coopower-cp640-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:05:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-lp1212-12v-12ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:05:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-djw670-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:05:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-panel-2w-x-10h>: HTTP status code is not handled or not allowed
2026-01-10 18:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/tables/conference_tables already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:05:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6114 pages (at 100 pages/min), scraped 2559 items (at 45 items/min)
2026-01-10 18:05:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k2000-5-drawer-hang-on-side-cabinet-13-58w-x-20d-x-29-116h-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:05:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/astral-square-umbrella-w-centerpost-sunbrella-awning-137w-x-137d-x-110h-tuscan>: HTTP status code is not handled or not allowed
2026-01-10 18:05:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/johnlite-9266ns-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:05:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-single-cylinder-deadbolt-w-bumpstop-brushed-chrome>: HTTP status code is not handled or not allowed
2026-01-10 18:05:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/add-on-weight-for-monaco-bases-30-lb-weight-silver>: HTTP status code is not handled or not allowed
2026-01-10 18:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/mezzanines_modular_structures/modular-wall-systems already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:05:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-lp612-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:05:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/framed-view-binder-with-one-touch-ezd-rings-3inch-capacity-navy-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:05:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dyna-ray-dr7477s-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:05:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/tables/conference_tables>: HTTP status code is not handled or not allowed
2026-01-10 18:05:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerp020ld-fg-10-ner-food-grade-hoist-with-push-trolley-2-ton-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:05:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dyna-ray-dr7375sg-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:05:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerm020l-l-fg-10-ner-food-grade-hoist-with-motorized-trolley-2-ton-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:05:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lithonia-elb0612a-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:05:24 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/material-handling/mezzanines_modular_structures/modular-wall-systems> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/material-handling/mezzanines_modular_structures/modular-wall-systems landed on page that is not a product page.
2026-01-10 18:05:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amscope-40x-2500x-led-digital-binocular-compound-microscope-with-3d-stage-usb-camera>: HTTP status code is not handled or not allowed
2026-01-10 18:05:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-full-length-lab-coat-snap-cuff-light-blue-4xl>: HTTP status code is not handled or not allowed
2026-01-10 18:05:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-3-4-length-jacket-snap-cuff-teal-5xl>: HTTP status code is not handled or not allowed
2026-01-10 18:05:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-cvec50i-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:05:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4198-standard-pivot-nub-assembly>: HTTP status code is not handled or not allowed
2026-01-10 18:05:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2109-standard-tslot-cover>: HTTP status code is not handled or not allowed
2026-01-10 18:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/structural_framing already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:05:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-cvt3rw5-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:05:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-6tsm3-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:05:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12006-tslot-tread-strip-per-meter>: HTTP status code is not handled or not allowed
2026-01-10 18:05:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ademco-465654-6v-5ah-alarm-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:05:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ge-concord-4-12v-45ah-alarm-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:05:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machinists-level-w-ground-graduated-vial-12l-x-2w-x-3h-wood-case>: HTTP status code is not handled or not allowed
2026-01-10 18:05:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peg-perego-igor0050-ride-on-toys-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:05:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/notice-truck-drivers-ring-bell--wait-sign-aluminum-10-x-14-blackbluewhite>: HTTP status code is not handled or not allowed
2026-01-10 18:05:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4184-90-living-nub>: HTTP status code is not handled or not allowed
2026-01-10 18:05:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/no-riders-except-operator-sign-adhesive-vinyl-3-x-7-blackwhite-pack-of-5>: HTTP status code is not handled or not allowed
2026-01-10 18:05:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2472-pvc-coated-wire-mesh-panel>: HTTP status code is not handled or not allowed
2026-01-10 18:05:43 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/structural_framing> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/structural_framing landed on page that is not a product page.
2026-01-10 18:05:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2635-alumalite-panel-silver>: HTTP status code is not handled or not allowed
2026-01-10 18:05:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-1000-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:05:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3410-flat-head-socket-cap-screw-58l>: HTTP status code is not handled or not allowed
2026-01-10 18:05:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3120-slidein-economy-tslot-stud>: HTTP status code is not handled or not allowed
2026-01-10 18:05:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enter-only-traffic-sign-egp-reflective-aluminum-18-x-18-blackwhite>: HTTP status code is not handled or not allowed
2026-01-10 18:05:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3090-double-anchor-fastener-short-assembly>: HTTP status code is not handled or not allowed
2026-01-10 18:05:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caution-move-on-green-only-sign-mirror-image-aluminum-14-x-20-blackyellow>: HTTP status code is not handled or not allowed
2026-01-10 18:05:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3111-button-head-socket-cap-screw-58l>: HTTP status code is not handled or not allowed
2026-01-10 18:05:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ner025s-15-ner-electric-hoist-hook-suspension-2-12-ton-15-lift-22-ftmin-208v>: HTTP status code is not handled or not allowed
2026-01-10 18:05:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ner003sd-20-ner-dual-speed-electric-chain-hoist-14-ton-20-lift-366-ftmin-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:05:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ada-handicapped-traffic-safety-sign-egp-aluminum-24-x-24-whiteblue>: HTTP status code is not handled or not allowed
2026-01-10 18:05:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wrong-way-bicycle-traffic-safety-sign-hip-aluminum-18-x-12-whitered>: HTTP status code is not handled or not allowed
2026-01-10 18:05:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/atk-604-cc-604cc-motorcycle-replacement-battery-1991-1992-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:05:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kawasaki-zx6r-zzr-600cc-motorcycle-replacement-battery-2005-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:05:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/atk-605-cc-605cc-motorcycle-replacement-battery-1993-2000-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:06:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mbk-sorriso-50cc-motorcycle-replacement-battery-1984-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:06:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerp020s-15-ner-electric-chain-hoist-push-trolley-2-ton-15-lift-28-ftmin-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:06:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mbk-active-50cc-motorcycle-replacement-battery-1984-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:06:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/retaining-magnet-assembly-threaded-bushing-126-dia-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:06:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-mobile-utility-table-20-x-16-undershelf--3-drawers-304-grade>: HTTP status code is not handled or not allowed
2026-01-10 18:06:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9800-system-340-voc-dtm-urethane-mastic-white-9892383>: HTTP status code is not handled or not allowed
2026-01-10 18:06:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/al100-hand-chain-hoist-aluminum-1-12-ton-capacity-15-ft-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:06:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snerp030c-10-sner-electric-hoist-push-trolley-3-ton-10-lift-35-ftmin-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:06:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electra-voy-electric-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:06:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6210 pages (at 96 pages/min), scraped 2600 items (at 41 items/min)
2026-01-10 18:06:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fortress-1700fs-mobility-scooter-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:06:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-only-label-w-recycle-sign-plastic-7-x-10>: HTTP status code is not handled or not allowed
2026-01-10 18:06:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drum-lifting-hook-spark-resistant-1000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:06:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-channel-fixed-volume-pipettor-71212122-50ul-volume>: HTTP status code is not handled or not allowed
2026-01-10 18:06:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60410006963-roll-372l-8w-x-150l-x-m9>: HTTP status code is not handled or not allowed
2026-01-10 18:06:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kb-unit-heater-with-bracket-thermostat-5-kw-480v-1-or-3-phase>: HTTP status code is not handled or not allowed
2026-01-10 18:06:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ceramic-round-base-magnet-rb50c-35-lbs-pull>: HTTP status code is not handled or not allowed
2026-01-10 18:06:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-tek-polykor-seamless-knit-blended-cr-gloves-nitrile-coated-ansi-a6-xl-black-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 18:06:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-tek-polykor-seamless-knit-blended-cr-gloves-nitrile-coated-ansi-a4-s-blue-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 18:06:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mlw-48-32-4006-shockwavemlw-40-piece-drill-drive-bit-set>: HTTP status code is not handled or not allowed
2026-01-10 18:06:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-recycled-paper-8-1-2-inch-x-11-inch-20-lb-white-5000-sheets-carton>: HTTP status code is not handled or not allowed
2026-01-10 18:06:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durapro-knee-boots-safety-loc-outsole-steel-toe-size-9-15h-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:06:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/loop-tape-individual-dots-with-adhesive-78l-x-78w-white-pack-of-900>: HTTP status code is not handled or not allowed
2026-01-10 18:06:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inkjet-embossed-note-cards-5-1-2-inch-x-4-1-4-inch-matte-ivory-60-cards-box>: HTTP status code is not handled or not allowed
2026-01-10 18:06:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aequitron-medical-mcr911d-muscle-stimulator-medical-replacement-battery-7ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:06:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oxford-28-square-commercial-planter-black>: HTTP status code is not handled or not allowed
2026-01-10 18:06:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gold-fibre-jr-legal-pads-5-inch-x-8-inch-16-lb-white-50-sheets-pad-4-pads-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:06:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lionville-systems-power-rider-sl-250-medical-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:06:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flex-cover-comp-book-7-inch-x-8-1-2-inch-wide-ruled-manila-48-sheets-pad>: HTTP status code is not handled or not allowed
2026-01-10 18:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/paper_stationery/notebooks_pads already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:06:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/physio-control-life-stat-1600-printer-medical-replacement-battery-1-3ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:06:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hook-tape-individual-dots-with-adhesive-12l-x-12w-white-pack-of-1440>: HTTP status code is not handled or not allowed
2026-01-10 18:06:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/woven-adhesive-bandage-extra-heavy-weight-2-x-3-25-box>: HTTP status code is not handled or not allowed
2026-01-10 18:06:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ibt-technologies-bt12-12-sealed-lead-acid-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:06:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sola-3000-s31000-s31000r-sealed-lead-acid-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:06:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dc-powered-jib-crane-2000-lb-capacity-87-14h-span-106-12h-under-beam>: HTTP status code is not handled or not allowed
2026-01-10 18:06:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fold-down-forklift-work-maintenance-platform-600-lb-capacity-37l-x-37w-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:06:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackable-shelf-bin-11w-x-12d-x-7h-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:06:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worksaver-big-tab-insertable-tab-divider-blank-85x11-8-tabs-white-multicolor>: HTTP status code is not handled or not allowed
2026-01-10 18:06:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/paper_stationery/notebooks_pads> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/paper_stationery/notebooks_pads landed on page that is not a product page.
2026-01-10 18:06:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackable-shelf-bin-8-1-4w-x-14d-x-7h-ivory>: HTTP status code is not handled or not allowed
2026-01-10 18:06:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lincoln-electric-company-b-s-g7-industrial-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:06:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-decker-electromate-400-jump-starter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:06:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackable-shelf-bin-8-1-4w-x-20-1-2d-x-7h-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:06:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-step-mate-stand-with-handrail-22-78l-x-25-1516w-x-43-18h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:06:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-unit-36w-x-14d-x-74h-with-35-ssb441-stackable-shelf-bins-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:06:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-patrol-sla1119-88-watt-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:06:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-pocket-drawer-organizer-plastic-tray-10l-x-3w-x-14h>: HTTP status code is not handled or not allowed
2026-01-10 18:06:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optiway-technology-2000-mini-u1-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:06:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bare-ground-clamp-direct-burial-bronze-1-14-2-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:06:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bubble-sof-tred-12-thick-safety-anti-fatigue-floor-mat-3x12-black>: HTTP status code is not handled or not allowed
2026-01-10 18:06:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-power-group-ub12180-wheelchair-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:06:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amigo-mobility-rt-express-jr-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:06:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-clear-quartz-lamp-630-16209-for-222-223-and-mm-electric-infrared-heaters-1600w-208v>: HTTP status code is not handled or not allowed
2026-01-10 18:06:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/950-1004-950-case-w-foam-228l-x-183w-x-117h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:07:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90-degree-liquid-tight-connector-alloy-steel-1-size-5-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:07:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/935-1006-935-case-w-foam-220l-x-140w-x-90h-olive>: HTTP status code is not handled or not allowed
2026-01-10 18:07:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-nut-silicon-bronze-38-16-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:07:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bright-way-group-bw-12350-nb-sealed-lead-acid-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:07:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-step-tall-nestable-plast-step-stand-black-25-25-d-14-3-4-h-nbst-1-01>: HTTP status code is not handled or not allowed
2026-01-10 18:07:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machine-screw-hex-nut-grade-2-carbon-steel-12-24-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:07:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-person-stage-24-inch-w-x-28-ft-l-3128>: HTTP status code is not handled or not allowed
2026-01-10 18:07:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ef-flame-resistant-classic-coverall-cec2-navy-size-62-regular>: HTTP status code is not handled or not allowed
2026-01-10 18:07:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6308 pages (at 98 pages/min), scraped 2646 items (at 46 items/min)
2026-01-10 18:07:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-person-stage-28-inch-w-x-24-ft-l-3224>: HTTP status code is not handled or not allowed
2026-01-10 18:07:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ef-flame-resistant-relaxed-fit-denim-jeans-pej2-dark-denim-125-oz-size-38-x-37u>: HTTP status code is not handled or not allowed
2026-01-10 18:07:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lb-threaded-conduit-body-w-cover-and-gasket-34-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:07:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-nut-18-8-stainless-steel-12-13-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:07:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insulated-ground-bushing-w-lay-in-lug-zincaluminum-1-14-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:07:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smrtvrmt-handheld-ir-remote-for-smrtv60240-control>: HTTP status code is not handled or not allowed
2026-01-10 18:07:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nsf-37-certified-air-curtain-120-inch-w-door-120v-3-4hp-1-ph-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:07:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fsk-2424-field-service-kit-with-work-surface-ground-cord-wrist-strap>: HTTP status code is not handled or not allowed
2026-01-10 18:07:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pride-mobility-gogo-elite-traveller-plus-wheelchair-replacement-battery-22ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:07:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5506-class-3-standard-moisture-wicking-tshirt-with-chest-pocket-orange-xl>: HTTP status code is not handled or not allowed
2026-01-10 18:07:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-walldriller-anchor-kit-w-phillips-wafer-head-screw-8-size-50-pieces>: HTTP status code is not handled or not allowed
2026-01-10 18:07:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pull-rope-polypropylene-14-x-1000-size>: HTTP status code is not handled or not allowed
2026-01-10 18:07:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheelcare-superlight-scooter-patriot-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:07:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cub-cadet-sit-down-under-seat-lawn-and-garden-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:07:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1801-standard-class-2-5point-breakaway-vest-lime-medium>: HTTP status code is not handled or not allowed
2026-01-10 18:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:07:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2005-standard-class-3-two-tone-mesh-zipper-safety-vest-lime-medium>: HTTP status code is not handled or not allowed
2026-01-10 18:07:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1008-standard-class-2-two-tone-mesh-hook-loop-safety-vest-orange-large>: HTTP status code is not handled or not allowed
2026-01-10 18:07:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1004-standard-class-2-mesh-hook-loop-safety-vest-orange-large>: HTTP status code is not handled or not allowed
2026-01-10 18:07:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perf-24-w-9-step-stl-roll-lad-21-d-top-stp-hndrl-lck-orng-fs093221po>: HTTP status code is not handled or not allowed
2026-01-10 18:07:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snap-in-knockout-seal-carbon-steel-1-14-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:07:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wallpro-400-black-wall-mount-retracting-barrier-15-blue-belt>: HTTP status code is not handled or not allowed
2026-01-10 18:07:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-cap-screw-grade-5-carbon-steel-12-13-x-34-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/pneumatic_valves/directional_control_valves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:07:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microfiber-towels-assorted-2lb-bulk-bag-2503-ac-bg>: HTTP status code is not handled or not allowed
2026-01-10 18:07:38 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers landed on page that is not a product page.
2026-01-10 18:07:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/half-90-door-swing-sign-black-on-yellow-28-x-28>: HTTP status code is not handled or not allowed
2026-01-10 18:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:07:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/can-am-outlander-max-500-efi-500cc-atv-replacement-battery-2011-2014-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:07:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-bellman-cart-bcf107ss-straight-uprights-gray-carpet-gray-bumper>: HTTP status code is not handled or not allowed
2026-01-10 18:07:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peg-perego-santa-fe-train-set-ride-on-toys-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:07:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/auto180-xtreme-duty-automatic-stapler-180-sheet-capacity-black-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:07:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chamberlain-3-4-hps-myq-belt-drive-garage-door-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:07:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-degree-easyjet-mc101a-motorcaddy-and-golf-caddy-replacement-battery-26ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:07:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrs206151r-cast-iron-right-angle-worm-gear-reducer-151-ratio>: HTTP status code is not handled or not allowed
2026-01-10 18:07:45 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/pneumatic_valves/directional_control_valves> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/pneumatic_valves/directional_control_valves landed on page that is not a product page.
2026-01-10 18:07:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-plate-screw-kit-brass-nylon-12-compartment-6-32-size-assorted-450-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:07:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 18:07:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-washer-stainless-steel-0-316-id-0-716-od-8-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:07:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peg-perego-case-ih-magnum-tractor-ride-on-toys-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:07:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drywall-screw-phillips-bugle-head-fine-thread-6-x-1-size-tuff-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:07:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lucky-duck-lucky-flapper-specklebelly-goose-12-decoy-replacement-battery-5ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:07:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/account-book-journal-ruled-12-1-8-x-7-1-2-blue-cover-500-sheets-pad>: HTTP status code is not handled or not allowed
2026-01-10 18:07:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrs237151r-cast-iron-right-angle-worm-gear-reducer-151-ratio>: HTTP status code is not handled or not allowed
2026-01-10 18:07:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kawasaki-zx1000-ninja-zx-10r-30th-anniversary-motorcycle-battery-2015-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:07:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrs175401l-cast-iron-right-angle-worm-gear-reducer-401-ratio>: HTTP status code is not handled or not allowed
2026-01-10 18:07:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrs23751l-cast-iron-right-angle-worm-gear-reducer-51-ratio>: HTTP status code is not handled or not allowed
2026-01-10 18:07:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrf262301r145tc-cast-iron-right-angle-worm-gear-reducer-301-ratio-145t-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:08:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-bands-size-16-2-1-2x-1-16-natural-1-lb-box>: HTTP status code is not handled or not allowed
2026-01-10 18:08:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k-lath-metal-piercing-screw-phillips-wafer-head-8-x-12-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:08:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrf325601de145tc-cast-iron-right-angle-worm-gear-reducer-601-ratio-145t-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:08:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrf325301l1824tc-cast-iron-right-angle-worm-gear-reducer-301-ratio-1824t-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:08:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-liquid-tight-connector-zinc-die-cast-2-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:08:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pop-up-notes-dispenser-3-in-x-3-in-black-dispenser-50-sheets-dispenser-1-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:08:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-flags-3-16-x-1-assorted-240-flags-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:08:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6402 pages (at 94 pages/min), scraped 2688 items (at 42 items/min)
2026-01-10 18:08:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-tap-bolt-silicon-bronze-12-13-x-2-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:08:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-tap-bolt-stainless-steel-12-13-x-1-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:08:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pistol-case-16l-x-13w-x-5h-black-diamond-plate>: HTTP status code is not handled or not allowed
2026-01-10 18:08:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-offset-strut-strap-carbon-steel-1-14-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:08:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-add-on-cab73-2442-7x-42-inch-w-x-24-inch-d-x-73-inch-h-7-shelves-18-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:08:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c0001-container-placard-label-holder-cstb5-6-x-8-white>: HTTP status code is not handled or not allowed
2026-01-10 18:08:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bx1642x-42-inch-w-x-16-inch-d-18-gauge-800-lb-capacity-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:08:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5000-replacement-roller-kit-4-rollers-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:08:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/19-dia-x-16-ga-galvanized-roller-42072-30-gp-for-30-oaw-omni-conveyors-abec-bearings>: HTTP status code is not handled or not allowed
2026-01-10 18:08:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kawasaki-zx1000-ninja-zx-10r-abs-30th-anniversary-1000cc-motorcycle-battery-2015-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:08:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-starter-csb73-1236-6-36-inch-w-x-12-inch-d-x-73-inch-h-6-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:08:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-ironhorse-thunder-1820cc-motorcycle-replacement-battery-2000-2002-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:08:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-super-jet-sj700bm-700cc-personal-watercraft-battery-2009-2014-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/pneumatic_valves/directional_control_valves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:08:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-deluxe-warmer-ladle-unit-9-1-4w-11-3-4d-9h-model-a>: HTTP status code is not handled or not allowed
2026-01-10 18:08:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/old-english-furniture-scratch-cover-for-lite-wood-8oz-btl-6cs-rac75462>: HTTP status code is not handled or not allowed
2026-01-10 18:08:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twinkle-stainless-steel-cleaner-polish-17oz-aerosol-1-case-dvo91224ea>: HTTP status code is not handled or not allowed
2026-01-10 18:08:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala174-exofit-x300-comfort-vest-safety-harness-back-d-ring-2xl>: HTTP status code is not handled or not allowed
2026-01-10 18:08:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wal-6-3-flute-extractor>: HTTP status code is not handled or not allowed
2026-01-10 18:08:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-fx-sho-1812cc-personal-watercraft-replacement-battery-2008-2014-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:08:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-ucp211-35-pillow-block-bearing-set-screw-locking-bore-55-5625-mm>: HTTP status code is not handled or not allowed
2026-01-10 18:08:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-ucf210-30-flange-mount-bearing-4-bolt-flange-set-screw-locking-bore-47-625-mm>: HTTP status code is not handled or not allowed
2026-01-10 18:08:37 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/pneumatic_valves/directional_control_valves> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/pneumatic_valves/directional_control_valves landed on page that is not a product page.
2026-01-10 18:08:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-21319exw33c3-95mm-bore-200mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:08:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zap-sx-electric-bicycle-electric-scooter-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:08:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-hcfu207-23-flange-mount-bearing-4-bolt-flange-eccentric-locking-collar-bore-36-5125-mm>: HTTP status code is not handled or not allowed
2026-01-10 18:08:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-22317exw33c3-85mm-bore-180mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:08:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-ucp213-65mm-pillow-block-bearing-set-screw-locking-bore-65-mm>: HTTP status code is not handled or not allowed
2026-01-10 18:08:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-23132ex1w33c3-160mm-bore-270mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:08:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dalton-3-wheel-sc-s235bl-electric-scooter-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:08:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-partition-wall-hanging-bracket-adjustable-angle-chrome-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 18:08:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zapworld-classic-scooter-electric-bicycle-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:08:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/piaggio-vespa-gts300-super-300cc-scooter-and-moped-battery-2009-2016-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:08:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strip-light-203040w-70040005600-lumens-350040005000k-100-277v-48l-white>: HTTP status code is not handled or not allowed
2026-01-10 18:08:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pride-mobility-jazzy-614hd-mobility-scooter-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:08:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drive-medical-cirrus-dp-120-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:08:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thoratec-laboratories-cs600x-mobility-scooter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:08:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-row-cylindrical-roller-bearing-nj311myc3-55mm-bore-120mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:08:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/everest-jennings-2145104700-mobility-scooter-replacement-battery-10ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:08:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8960-bump-cap-wled-lighting-technology-lime-short-brim-one-size>: HTTP status code is not handled or not allowed
2026-01-10 18:08:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-partition-store-single-bay-cart-with-wire-baskets-25l-x-29-12w-x-58-12h-white>: HTTP status code is not handled or not allowed
2026-01-10 18:08:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/avigo-surge-24v-dirt-rider-electric-scooter-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:08:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/klip-it-open-starter-osk73-1248-8-48-inch-w-x-12-inch-d-x-73-inch-h-8-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:08:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frank-mobility-e-fix-e-20-standard-mobility-scooter-replacement-battery-35ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:08:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-in-t316-stainless-steel-hex-ball-valve-1-piece-1000-psi>: HTTP status code is not handled or not allowed
2026-01-10 18:08:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-stainless-steel-wire-shelving-unit-starter-72w-x-21d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:08:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/craftmatic-comfort-coach-6scooter-mobility-scooter-replacement-battery-35ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:09:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-in-x-5-1-2-in-stainless-steel-pipe-nipple-16168-psi-sch-40-domestic>: HTTP status code is not handled or not allowed
2026-01-10 18:09:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-in-x-4-1-2-in-lead-free-seamless-red-brass-pipe-nipple-140-psi-sch-40-import>: HTTP status code is not handled or not allowed
2026-01-10 18:09:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-2-in-x-4-in-lead-free-seamless-red-brass-pipe-nipple-140-psi-sch-40-import>: HTTP status code is not handled or not allowed
2026-01-10 18:09:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/golden-technologies-buzz-around-xls-3-wheel-gb117-gb117s-scooter-battery-12ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:09:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-bolt-closed-starter-cst75-2436-7x-36-inch-w-x-24-inch-d-x-75-inch-h-7-shelves-18-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:09:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-in-lead-free-brass-90-degree-elbow-fnpt-125-psi-import>: HTTP status code is not handled or not allowed
2026-01-10 18:09:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-skandic-550f-tundra-sport-550cc-snowmobile-battery-2010-2011-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:09:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-stainless-steel-wire-shelving-unit-add-on-54w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6499 pages (at 97 pages/min), scraped 2731 items (at 43 items/min)
2026-01-10 18:09:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-stainless-steel-wire-shelving-unit-add-on-24w-x-24d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pre-inked-message-stamp-past-due-1-5-8-x-1-2-red>: HTTP status code is not handled or not allowed
2026-01-10 18:09:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pre-inked-message-stamp-e-mailed-1-5-8-x-1-2-red>: HTTP status code is not handled or not allowed
2026-01-10 18:09:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-wire-shelving-unit-starter-72w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-grand-touring-600-593cc-snowmobile-replacement-battery-2003-2012-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:09:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-stainless-steel-wire-shelving-unit-add-on-30w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-poly-bags-20-x-24-8-mil-clear-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:09:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slide-seal-reclosable-poly-bags-12-1-2-x-9-3-mil-clear-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:09:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/certificate-holder-25-x-8-1-2-black-5-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:09:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/purchase-order-book-3-part-carbonless-5-9-16-x-8-7-16-50-sets-book>: HTTP status code is not handled or not allowed
2026-01-10 18:09:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-mx-z-600-50th-anniversary-snowmobile-replacement-battery-2009-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:09:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-mx-z-380f-368cc-snowmobile-replacement-battery-2001-2003-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:09:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-wire-shelving-unit-starter-48w-x-30d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-wire-shelving-unit-add-on-60w-x-30d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/literature-mailers-12-1-8-x-9-1-4-x-6-1-2-200lb-test-ect-32-white-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:09:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arctic-cat-m1000-efi-1000cc-snowmobile-replacement-battery-2007-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:09:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-wire-shelving-unit-starter-42w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-chrome-esd-wire-shelving-unit-starter-60w-x-12d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-mx-z-600-ho-renegade-renegade-x-600cc-snowmobile-battery-2004-2013-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:09:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/expansion-poly-mailers-15-x-20-x-4-2-5-mil-white-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:09:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-stainless-steel-wire-shelving-unit-starter-60w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-mx-z-500ss-trail-adrenaline-593cc-snowmobile-battery-2004-2005-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:09:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polaris-indy-frontier-classic-built-after-1-01-02-784cc-snowmobile-battery-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:09:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollardgard-anywhere-yellow-7-x-52-with-25-lb-octagon-rubber-base-bgaw752yw>: HTTP status code is not handled or not allowed
2026-01-10 18:09:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kwik-spin-w-maxcore-cable-25-feet-l-x-1-4-inch-w>: HTTP status code is not handled or not allowed
2026-01-10 18:09:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-8718-containment-berm-rapid-rise-15-x-30-copolymer-2000>: HTTP status code is not handled or not allowed
2026-01-10 18:09:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/integral-wound-1-2-inch-x-75-feet-cable-for-use-w-k-3800-drum-machine>: HTTP status code is not handled or not allowed
2026-01-10 18:09:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-8274-containment-berm-economy-12-x-12-copolymer-2000>: HTTP status code is not handled or not allowed
2026-01-10 18:09:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/miller-h500-construction-comfort-harness-with-front-d-ring-quick-connect-sm-green>: HTTP status code is not handled or not allowed
2026-01-10 18:09:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hollow-steel-half-glass-door-cylindrical-prep-curries-hinge-16-ga-32w-x-80h>: HTTP status code is not handled or not allowed
2026-01-10 18:09:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arctic-cat-cheetah-touring-500cc-snowmobile-replacement-battery-1988-1990-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:09:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plastic-locker-11-921212600-double-tier-12-x-12-x-30-1-wide-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:09:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/queuepro-250-retractable-belt-barrier-40-silver-post-11-black-belt-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 18:09:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plus-phenolic-locker-11-821818601-double-tier-18-x-18-x-30-dove-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:09:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freshaire-make-up-air-inverter-ptac-unit-with-heat-pump-11800-btu-cool-208230v>: HTTP status code is not handled or not allowed
2026-01-10 18:09:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2600wc-wire-clip-34l>: HTTP status code is not handled or not allowed
2026-01-10 18:09:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-mx-z-600-ho-adrenaline-593cc-snowmobile-replacement-battery-2006-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:09:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-730-2-piece-full-port-ball-valve-carbon-steel-1-12-threaded>: HTTP status code is not handled or not allowed
2026-01-10 18:09:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contractor-3-inch-stiff-scraper-angled-140900430>: HTTP status code is not handled or not allowed
2026-01-10 18:09:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-mx-z-600-adrenaline-600cc-snowmobile-replacement-battery-2004-2010-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:09:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-720-2-piece-conventional-port-ball-valve-carbon-steel-14-threaded>: HTTP status code is not handled or not allowed
2026-01-10 18:09:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-730-2-piece-full-port-ball-valve-carbon-steel-2-threaded>: HTTP status code is not handled or not allowed
2026-01-10 18:10:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sky-3-piece-outdoor-lounge-sets-23-5-8-w-x-15-11-16-h-table-black>: HTTP status code is not handled or not allowed
2026-01-10 18:10:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-365ss-butterfly-valve-with-epdm-seals--10-position-handle-4-lug>: HTTP status code is not handled or not allowed
2026-01-10 18:10:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sky-air-3-piece-outdoor-bar-set-23-5-8-w-x-42-1-2-h-table-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:10:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fao-physicianscare-antacid-50-x-2-box>: HTTP status code is not handled or not allowed
2026-01-10 18:10:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-712-2-piece-full-port-ball-valve-stainless-steel-38-threaded>: HTTP status code is not handled or not allowed
2026-01-10 18:10:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-546vbnl-lf-commercial-multi-turn-sillcock-valve-with-vacuum-breaker-12-fnpt>: HTTP status code is not handled or not allowed
2026-01-10 18:10:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-response-2-complete-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:10:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/argosrack-gun-open-rack-awr83-24r-holds-24-rifles-42w-x-15d-x-83h-battleship-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:10:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6597 pages (at 98 pages/min), scraped 2779 items (at 48 items/min)
2026-01-10 18:10:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/para-systems-minuteman-enspire-en400-ups-replacement-battery-5ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:10:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-337di-g-butterfly-valve-with-buna-seals--gear-operator-10-wafer>: HTTP status code is not handled or not allowed
2026-01-10 18:10:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alaris-medical-gemini-1320-medical-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:10:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parks-medical-6ca-doppler-medical-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:10:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/criticare-systems-504-pony-medical-replacement-battery-1-3ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:10:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-335ss-butterfly-valve-with-epdm-seals--10-position-handle-12-wafer>: HTTP status code is not handled or not allowed
2026-01-10 18:10:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-365di-g-butterfly-valve-with-epdm-seals--gear-operator-5-lug>: HTTP status code is not handled or not allowed
2026-01-10 18:10:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-coupled-pump-motor-z410-75hp-230v-3600rpm-1ph-213jm-fr-dp>: HTTP status code is not handled or not allowed
2026-01-10 18:10:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/114604b-round-dome-utility-electric-marker-white-pole-78h-54-above-ground-red>: HTTP status code is not handled or not allowed
2026-01-10 18:10:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2180-05476-blinkersignflashing-led-forklift-symbol-sign-30w-yellow-solar>: HTTP status code is not handled or not allowed
2026-01-10 18:10:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xantrex-technology-1500-jump-starter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:10:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/expertpower-exp650-sealed-lead-acid-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:10:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cxf-series-screw-plug-immersion-heater-2npt-1500w-600v-16-38l>: HTTP status code is not handled or not allowed
2026-01-10 18:10:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-90407-2-hp-220v-60hz-ultra-quiet-oil-free-air-compressor-motor>: HTTP status code is not handled or not allowed
2026-01-10 18:10:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/access-axs33f-axs5018-sealed-lead-acid-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:10:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hyperpure-pe-rt-tubing-34id-x-78od-x-500-coil-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:10:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/defender174-spdt-explosion-proof-hd-thermostat-heatcool-only-22a>: HTTP status code is not handled or not allowed
2026-01-10 18:10:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coopower-cpd12-24-sealed-lead-acid-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:10:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/werker-wkdc12-80p-sealed-lead-acid-replacement-battery-75ah-12v-it>: HTTP status code is not handled or not allowed
2026-01-10 18:10:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coopower-cph12-24-sealed-lead-acid-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:10:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/refrigeration-duty-motor-x528-1hp-3-4hp-900rpm-208-230-460v-3ph-56y-opao>: HTTP status code is not handled or not allowed
2026-01-10 18:10:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunnyway-swe12140-sealed-lead-acid-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:10:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conntek-c14lc13-098-10-amp-iec-c14-to-locking-iec-c13-with-push-lock-8>: HTTP status code is not handled or not allowed
2026-01-10 18:10:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nps-heavy-duty-table-standard-height-butcherblock-top-72l-x-30w-x-30h-mapleblack-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:10:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-gal-sat-blk-ash-trash-recept-sat-alum-lid-w-sand-cover-192-bk-sa>: HTTP status code is not handled or not allowed
2026-01-10 18:10:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunnyway-swe12120-sealed-lead-acid-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:10:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-blower-motor-c1160-5kcr49sn0150x-15hp-1725rpm-115-208-230v-1ph-56h-dp>: HTTP status code is not handled or not allowed
2026-01-10 18:10:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-pipe-fitting-rail-flange-1-dia>: HTTP status code is not handled or not allowed
2026-01-10 18:10:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rhino-sel-mh25860-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:10:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kung-long-wp22-12rn-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:10:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/w30w30g-pressure-type-wire-connector-300v-20a-1-516l>: HTTP status code is not handled or not allowed
2026-01-10 18:10:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coopower-cphl12-18-sealed-lead-acid-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:10:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunstone-power-spt6-5-sealed-lead-acid-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:10:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-max-ml18-12-sealed-lead-acid-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:10:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/volcano-kb12240-nb-sealed-lead-acid-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:10:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ulb420-15-multi-outlet-power-unit-120v-20a-10-34l-4-outlets-15-cord>: HTTP status code is not handled or not allowed
2026-01-10 18:10:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelon-blue-wire-shelving-unit-add-on-60w-x-21d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 18:10:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mhp3-2d-fl-pb-48w-x-24d-mobile-workbench-center-shelf-14-hardboard-top>: HTTP status code is not handled or not allowed
2026-01-10 18:10:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gruber-power-gps12-6-sealed-lead-acid-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:10:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vestil-fully-powered-25-reach-stacker-s-118-aa-fr-1500-lb-118-h-adj-forks-inside-adj-straddle-legs>: HTTP status code is not handled or not allowed
2026-01-10 18:10:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-sonic-ps-6100f1-sealed-lead-acid-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:10:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-sonic-ps-1250f1-sealed-lead-acid-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:10:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-black-epoxy-wire-shelving-unit-add-on-42w-x-14d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:10:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ironguard-steel-faced-dock-bumper-22-1100-13-w-x-4-d-x-20-h>: HTTP status code is not handled or not allowed
2026-01-10 18:11:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gogreen-power-gg-13725-25-extension-cord-orange-green>: HTTP status code is not handled or not allowed
2026-01-10 18:11:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunnyway-sw1240-ii-sealed-lead-acid-replacement-battery-4-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:11:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-patrol-sla1119-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:11:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fill-vent-with-6-flame-arrester>: HTTP status code is not handled or not allowed
2026-01-10 18:11:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ironguard-laminated-dock-bumper-24-3488-16-w-x-9-d-x-10-h>: HTTP status code is not handled or not allowed
2026-01-10 18:11:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-gallon-funnel-for-non-flammables>: HTTP status code is not handled or not allowed
2026-01-10 18:11:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelate-silver-epoxy-wire-shelving-unit-add-on-60w-x-24d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:11:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/51428-deluxe-medical-cart-with-swinging-hinged-door-23-x-19-x-35-global-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:11:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6692 pages (at 95 pages/min), scraped 2822 items (at 43 items/min)
2026-01-10 18:11:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-vertical-55-gal-drum-2-door-manual-drum-acid-cabinet-59w-x-34d-x-65h-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:11:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/invacare-pte-14-inch-or-less-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:11:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ge-security-caddx-networx-nx-4-alarm-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:11:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21-utility-cart-handle-nexelate-price-each-package-of-2>: HTTP status code is not handled or not allowed
2026-01-10 18:11:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelate-silver-epoxy-wire-shelving-unit-starter-42w-x-24d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:11:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fallte-82706sb1-duratech-6-compact-web-srd-with-steel-carabiner-and-snap-hook>: HTTP status code is not handled or not allowed
2026-01-10 18:11:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-nexelate-silver-epoxy-wire-shelving-unit-starter-42w-x-14d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 18:11:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/golden-technologies-gc322-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:11:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/four-wing-free-air-fan-blade-interchangeable-hub-aluminum-blade-ccw-14-inch-dia-27-pitch>: HTTP status code is not handled or not allowed
2026-01-10 18:11:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bruno-pacesaver-scout-rf-wheelchair-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:11:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-inlet-blower-wheel-9-1-2-inch-dia-cw-or-ccw-9-1-2-inch-w-3-4-inch-bore>: HTTP status code is not handled or not allowed
2026-01-10 18:11:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-slim-brief-16-15-1-4-x-2-x-11-1-2-black>: HTTP status code is not handled or not allowed
2026-01-10 18:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/bags_cases/backpacks_duffle_bags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:11:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-z-brite-wire-shelving-unit-starter-54w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 18:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:11:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-inlet-blower-wheel-8-35-64-inch-dia-cw-2050-rpm-1-2-inch-bore-3-inch-w-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 18:11:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-inlet-blower-wheel-8-1-2-inch-dia-ccw-1650-rpm-1-2-inch-bore-3-3-16-inch-w-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 18:11:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/big-beam-h2se12s20-emergency-light-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:11:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portalac-gs-pe4512-emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:11:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ma-020-22x-handheld-led-light-magnifier>: HTTP status code is not handled or not allowed
2026-01-10 18:11:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/900-112-hobby-knife-small>: HTTP status code is not handled or not allowed
2026-01-10 18:11:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sure-lites-12xr-206-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:11:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portalac-tev12210-emergency-light-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:11:32 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/bags_cases/backpacks_duffle_bags> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/bags_cases/backpacks_duffle_bags landed on page that is not a product page.
2026-01-10 18:11:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portalac-lac-cf18-emergency-light-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:11:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cp-351b-non-insulated-terminal-crimper-awg-8-2>: HTTP status code is not handled or not allowed
2026-01-10 18:11:33 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers landed on page that is not a product page.
2026-01-10 18:11:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/902-215-1000v-insulated-screwdriver-plier-set>: HTTP status code is not handled or not allowed
2026-01-10 18:11:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100-021-6-needle-nosed-pliers-serrated>: HTTP status code is not handled or not allowed
2026-01-10 18:11:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/click-torque-wrench-one-scale-38-drive-10-100-ftlb-16-34l>: HTTP status code is not handled or not allowed
2026-01-10 18:11:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teledyne-h2lt6s20-emergency-light-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:11:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/902-332-lunar-crimper-for-insulated-flag-terminals-awg-12-10-and-14-16>: HTTP status code is not handled or not allowed
2026-01-10 18:11:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p-touch-tze-labeling-tape-1w-white-on-black>: HTTP status code is not handled or not allowed
2026-01-10 18:11:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p-touch-tze-extra-strength-adhesive-labeling-tape-1-2w-black-on-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:11:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p-touch-tc-tape-cartridges-1-2w-black-on-white-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:11:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/continuous-length-shipping-label-tape-for-ql-1050-4in-x-100ft-roll-white>: HTTP status code is not handled or not allowed
2026-01-10 18:11:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-high-cap-boltless-shelving-add-on-72-in-w-x-24-in-d-x-96-in-h-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:11:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filter-lcd-privacy-185-bk>: HTTP status code is not handled or not allowed
2026-01-10 18:11:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-sonic-erb-0604-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:11:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-yellow-chart-tape>: HTTP status code is not handled or not allowed
2026-01-10 18:11:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/imc270ms-ice-maker-compact-portable-metallic-silver-makes-27-lbs-per-day>: HTTP status code is not handled or not allowed
2026-01-10 18:11:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/880mp-floor-box-modular-non-metallic-rectangular-floor-box>: HTTP status code is not handled or not allowed
2026-01-10 18:11:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-extra-heavy-duty-boltless-shelving-add-on-36-in-w-x-18-in-d-x-96-in-h>: HTTP status code is not handled or not allowed
2026-01-10 18:11:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hl10000-corner-l-steel-desk-left-hand-return-66-x-72-charcoal-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 18:11:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wm-divulge-4-magazine-wall-display-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 18:11:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-wide-boltless-shelving-add-on-96in-w-x-24in-d-x-60in-h-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/office_furniture/literature_mail_sorters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:11:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simplex-18ah-retrofit-emergency-light-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:11:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ballistic-blanket-level-iii-a-jumbo-48l-x-72w-black>: HTTP status code is not handled or not allowed
2026-01-10 18:11:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lithonia-lithonia-elsq-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:12:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/value-line-storage-cabinet-all-welded-30w-x-18d-x-72h-textured-black>: HTTP status code is not handled or not allowed
2026-01-10 18:12:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/playmate-volley-tennis-ball-machine-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:12:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-yfm66fa-fg-grizzly-660cc-atv-replacement-battery-2005-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:12:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ps-88-pc-green-privacy-screen>: HTTP status code is not handled or not allowed
2026-01-10 18:12:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drum-overfill-alert-gauge-aluminum-bushing-galvanized-rod-pp-float-3-4-fitting-12-depth>: HTTP status code is not handled or not allowed
2026-01-10 18:12:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/four-shelf-extra-hd-boltless-shelving-add-on-48inw-x-24ind-x-60inh-wood-deck-usa>: HTTP status code is not handled or not allowed
2026-01-10 18:12:06 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/office_furniture/literature_mail_sorters> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/office_furniture/literature_mail_sorters landed on page that is not a product page.
2026-01-10 18:12:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regenerative-blower-ab-200-3-phase-1-stage-125-hp>: HTTP status code is not handled or not allowed
2026-01-10 18:12:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/five-shelf-extra-hd-boltless-shelving-add-on-36inw-x-24ind-x-96inh-wood-deck-usa>: HTTP status code is not handled or not allowed
2026-01-10 18:12:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plug-n-go-pcd-w-tcd-shark-cw-002-1349-00-1-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:12:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/numatic-henry-hepa-flo-filter-bags-130-180-200-models-hepa-h11-gk-nvm1ch-hepa>: HTTP status code is not handled or not allowed
2026-01-10 18:12:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6791 pages (at 99 pages/min), scraped 2863 items (at 41 items/min)
2026-01-10 18:12:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/can-am-outlander-800-max-800cc-atv-replacement-battery-2006-2013-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/partitions_dividers/acoustical_partition_panels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:12:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/can-am-outlander-max-500-500cc-atv-replacement-battery-2007-2013-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:12:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smoking-shelter-64wsvrdkb-3sided-l-r-open-fr-15l-x-10w-vented-standing-seam-roof-dk-brz>: HTTP status code is not handled or not allowed
2026-01-10 18:12:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-computer-workstation-with-slide-out-keyboard-shelf-30-w-x-18-d-x-74-h-chrome>: HTTP status code is not handled or not allowed
2026-01-10 18:12:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd18-one-18-skate>: HTTP status code is not handled or not allowed
2026-01-10 18:12:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chamberlain-3-4-hps-myq-belt-whisper-drive-garage-door-battery-5ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:12:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd30-2-two-30-skates>: HTTP status code is not handled or not allowed
2026-01-10 18:12:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aprilia-rsv-1000-r-1000cc-motorcycle-replacement-battery-2004-2011-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:12:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kymco-heroism-125cc-motorcycle-replacement-battery-1995-1996-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:12:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k2027-4-hdg-carbon-eyebolt-shoulder-pattern-5-8-11-4-shank-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 18:12:21 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/partitions_dividers/acoustical_partition_panels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/partitions_dividers/acoustical_partition_panels landed on page that is not a product page.
2026-01-10 18:12:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-cabinet-workbench-with-3-shelves--floor-lock-72w-x-30d-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:12:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k2025-316ss-316-stainless-eyebolt-shoulder-pattern-1-2-13-1-1-2-shank>: HTTP status code is not handled or not allowed
2026-01-10 18:12:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multithotic-orthotic-anti-fatigue-insole-womens-567>: HTTP status code is not handled or not allowed
2026-01-10 18:12:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suzuki-dr250se-250cc-motorcycle-replacement-battery-1990-1995-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:12:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-gauge-mobile-bench-cabinet-2211a-lu-95-4-drawers>: HTTP status code is not handled or not allowed
2026-01-10 18:12:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/945-case-w-foam-25-1-8l-x-19-7-8w-x-8-13-16h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:12:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/whf-series-replacement-grille-whfg-white>: HTTP status code is not handled or not allowed
2026-01-10 18:12:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-fiberglass-jaw-style-mop-handle-red-12-pack-36947505>: HTTP status code is not handled or not allowed
2026-01-10 18:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/cove_heaters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:12:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lug-gray-fda-plastic-tub-for-lug-carts-25-l-x-15-1-2-w-x-8-3-4-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/electric_baseboard_heaters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:12:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd-welded-workbench-72-x-36-lower-shelf--pegboard-panel-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 18:12:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/286960000-graduated-cylinder-tpx-polymethylpentene-1000ml>: HTTP status code is not handled or not allowed
2026-01-10 18:12:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suzuki-dr650se-cn-650cc-motorcycle-replacement-battery-1996-1997-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:12:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-cabinet-flush-door-with-264-yellow-bins-16-ga-all-welded-cabinet-72-w-x-24-d-x-84-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:12:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/371110002-round-spinbar-magnetic-stir-bar-teflon-ptfe-2l-x-5-16dia-white>: HTTP status code is not handled or not allowed
2026-01-10 18:12:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gssafe-5113-class-3-microfiber-birdseye-short-sleeve-t-shrit-w-black-bottom-lime-3xl>: HTTP status code is not handled or not allowed
2026-01-10 18:12:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-reclosable-sandwich-bags-in-dispenser-box-1-mil-6-12-6>: HTTP status code is not handled or not allowed
2026-01-10 18:12:41 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/cove_heaters> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/cove_heaters landed on page that is not a product page.
2026-01-10 18:12:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-layflat-polypropylene-bags-1-5-mil-4-34-6-34-1000ctn>: HTTP status code is not handled or not allowed
2026-01-10 18:12:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/electric_baseboard_heaters> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/electric_baseboard_heaters landed on page that is not a product page.
2026-01-10 18:12:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-stp-stl-safet-roll-lad-wt-actu-stp-24-expan-stp-wa154014x>: HTTP status code is not handled or not allowed
2026-01-10 18:12:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd-welded-workbench-48-x-30-open-base--louvered-panel-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 18:12:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-cl1385ee-4-1-2dia-x-64h-yellow-w-no-tape>: HTTP status code is not handled or not allowed
2026-01-10 18:12:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-stp-stl-safet-roll-lad-wt-actu-stp-24-perf-stp-wa073214p>: HTTP status code is not handled or not allowed
2026-01-10 18:12:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-cl1385qq64-4-1-2dia-x-64h-black-w-no-tape>: HTTP status code is not handled or not allowed
2026-01-10 18:12:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/piaggio-vespa-free-25cc-scooter-and-moped-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:12:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clearance-bar-htgrd796yw-7dia-x-96l-yellow-w-white-tape-graphics>: HTTP status code is not handled or not allowed
2026-01-10 18:12:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z-scooters-z-rider-electric-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:12:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-60w-x-14d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:12:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/star-ii-036d-deluxe-electric-scooter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 18:12:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vestil-all-terrain-pallet-jack-truck-all-t-hd-32-l-forks-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:12:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p127-25m-vac-bolt-test-gauge-0-30-hg-vacuum-liquid-filled-use-w-popular-filter-can-models>: HTTP status code is not handled or not allowed
2026-01-10 18:12:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-48w-x-21d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:12:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kn-rp47c-rattle-paddle-47-red>: HTTP status code is not handled or not allowed
2026-01-10 18:12:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vestil-fully-powered-counter-balanced-stacker-s-cb-62-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:13:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-48w-x-24d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:13:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rad2go-great-white-e36-electric-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 18:13:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-mount-refrigerator-single-door>: HTTP status code is not handled or not allowed
2026-01-10 18:13:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelate-60w-x-21d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:13:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2du1883-cantilever-rack-double-sided-upright-83d-x-18h>: HTTP status code is not handled or not allowed
2026-01-10 18:13:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-36w-x-24d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:13:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-gtx-800-ho-800cc-snowmobile-replacement-battery-2006-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:13:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-mx-z-1000-sdi-renegade-x-998cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:13:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6886 pages (at 95 pages/min), scraped 2905 items (at 42 items/min)
2026-01-10 18:13:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wobbler-sign-holder-4>: HTTP status code is not handled or not allowed
2026-01-10 18:13:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/can-am-commander-800-800cc-utv-replacement-battery-2011-2016-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:13:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slatwall-adapter-clip-1l>: HTTP status code is not handled or not allowed
2026-01-10 18:13:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drum-containment-dolly-1617y-70-gallon-cap-10-wheels-polyethylene>: HTTP status code is not handled or not allowed
2026-01-10 18:13:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-manual-pallet-jack-gwk-cfp-lw-fits-lift-rite-model-cf>: HTTP status code is not handled or not allowed
2026-01-10 18:13:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beaded-chain-coupling-style-6-ball-24l>: HTTP status code is not handled or not allowed
2026-01-10 18:13:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-freeride-146-154-800r-800cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 18:13:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-36w-x-14d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:13:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cubby-cabinet-cc-52-18-welded-34-1-2w-x-13-1-2d-x-52h-bright-red>: HTTP status code is not handled or not allowed
2026-01-10 18:13:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vttr5-2424-24-x-24-18-ga-stainless-workbench-with-5-riser-galvanized-base>: HTTP status code is not handled or not allowed
2026-01-10 18:13:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-36w-x-14d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:13:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ventilated-locker-vdl-121836-c-02-double-tier-no-legs-3-wide-12x18x36-welded-med-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:13:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/SVTR-3024-24-W-x-30-D-T-430-18-ga-Stainless-Steel-Workbench-with-a-15-backsplash>: HTTP status code is not handled or not allowed
2026-01-10 18:13:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelite-72w-x-24d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/ink_toner/inkjet_ink_cartridges already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:13:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cushion-tire-lift-lock-keyed-alike-ctll-ka>: HTTP status code is not handled or not allowed
2026-01-10 18:13:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-60w-x-18d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:13:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-54w-x-21d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:13:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-60w-x-21d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:13:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interior-mattes-with-beveled-edges-1-inch-x-3-inch-1-16-inch-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/panel_carts_trucks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:13:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-48w-x-24d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:13:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/facil-steel-flat-file-medium>: HTTP status code is not handled or not allowed
2026-01-10 18:13:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-top-receptacle-36-gallon-9895>: HTTP status code is not handled or not allowed
2026-01-10 18:13:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/ink_toner/inkjet_ink_cartridges>: HTTP status code is not handled or not allowed
2026-01-10 18:13:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chill-its-6489-2-layer-cooling-multi-band-performance-knit-s-m-hi-vis-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:13:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exit-device-lever-trim-grade-1-sfic-prep>: HTTP status code is not handled or not allowed
2026-01-10 18:13:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-b188-v-belt-5-8-x-191>: HTTP status code is not handled or not allowed
2026-01-10 18:13:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ww4284-8phfl-heavy-duty-7-gauge-mobile-workbench-8-phenolic-casters-floor-lock>: HTTP status code is not handled or not allowed
2026-01-10 18:13:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/panel_carts_trucks>: HTTP status code is not handled or not allowed
2026-01-10 18:13:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-b106-v-belt-5-8-x-109>: HTTP status code is not handled or not allowed
2026-01-10 18:13:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-24w-x-14d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:13:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-b258-v-belt-5-8-x-261>: HTTP status code is not handled or not allowed
2026-01-10 18:13:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-lockout-padlock-keyed-different-1-1-2-plastic-nylon-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:13:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-30w-x-14d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:13:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-b55-5l580-v-belt-5-8-x-58>: HTTP status code is not handled or not allowed
2026-01-10 18:13:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-lockout-padlock-keyed-different-1-1-2-aluminum-steel-orange-6-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:13:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-36w-x-14d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:13:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-em3710t-5g-3-ph-75-hp-575-v-1800-rpm-tefc-213t-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:13:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-3-8-thick-anti-fatigue-floor-mat-4-x-60-full-roll-brown-fm248720bn>: HTTP status code is not handled or not allowed
2026-01-10 18:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/locks_lockout_devices/lockout_tagout_devices/lockout_padlocks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:13:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-motor-460-v-150-hp-1785-rpm-3-ph-444ts-dp>: HTTP status code is not handled or not allowed
2026-01-10 18:13:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5213-glass-mug-coffee-13-oz-clear-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:13:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/as-iqcrew-40x-1000x-dual-illumination-microscope-digital-eyepiece-slide-prep-kit-book>: HTTP status code is not handled or not allowed
2026-01-10 18:13:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelite-36w-x-24d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:13:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-phase-motor-em4103t-5-1770-hp-25-rpm-284t-frame-c-face-mount-tefc-575-volts>: HTTP status code is not handled or not allowed
2026-01-10 18:13:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-30w-x-18d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:13:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-phase-motor-vem3550t-5-15-hp-3500-rpm-143tc-frame-c-face-mount-tefc-575-volts>: HTTP status code is not handled or not allowed
2026-01-10 18:13:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ken-forging-tb107-4-s-turnbuckle-assembly-stub-stub-5-8-11-x-11-carbon>: HTTP status code is not handled or not allowed
2026-01-10 18:14:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-cecp3581t-3-ph-1-hp-208-230-460-v-1765-rpm-tefc-143tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:14:00 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/locks_lockout_devices/lockout_tagout_devices/lockout_padlocks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/locks_lockout_devices/lockout_tagout_devices/lockout_padlocks landed on page that is not a product page.
2026-01-10 18:14:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelite-42w-x-21d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:14:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-tek-polykor-seamless-knit-polykor-glove-polyurethane-coated-flat-grip-xl-white-12pk>: HTTP status code is not handled or not allowed
2026-01-10 18:14:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ken-forging-tbs-03-rh-hdg-turnbuckle-stub-3-8-16-x-6-1-2-galvanized-right-hand>: HTTP status code is not handled or not allowed
2026-01-10 18:14:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ken-forging-tbs-10-rh-turnbuckle-stub-1-8-x-9-carbon-right-hand>: HTTP status code is not handled or not allowed
2026-01-10 18:14:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-motor-208-230-460-v-2-hp-3490-rpm-3-ph-145tc-tefc>: HTTP status code is not handled or not allowed
2026-01-10 18:14:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washdown-motor-idcswdm3542-3-phase-075-hp-1740-rpm-208-230-460-volts-tenv-56c-fr>: HTTP status code is not handled or not allowed
2026-01-10 18:14:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evo-vista-ascend-industrial-safety-helmet-type-i-vented-abs-shell-integrated-faceshield-white>: HTTP status code is not handled or not allowed
2026-01-10 18:14:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k290-scorpion-atv-tire-1108-2s-i-22x1100-8-2ply>: HTTP status code is not handled or not allowed
2026-01-10 18:14:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-poly-green-42w-x-14d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:14:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 6984 pages (at 98 pages/min), scraped 2946 items (at 41 items/min)
2026-01-10 18:14:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-poly-green-54w-x-21d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:14:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-poly-green-72w-x-24d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:14:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-poly-green-42wx24dx80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:14:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-54w-x-21d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:14:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1003654-00u0019-economy-retail-gondola-single-sided-36w-x-14d-x-54h-almond>: HTTP status code is not handled or not allowed
2026-01-10 18:14:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prefilled-homogenizer-tubes-2-0ml-silica-glass-beads-0-1mm-acid-washed-50-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:14:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-ecp3583t-3-ph-15-hp-208-230-460-v-3450-rpm-tefc-143t-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:14:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-resettable-3-dial-combination-padlock-16040-c-12>: HTTP status code is not handled or not allowed
2026-01-10 18:14:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magic-clamp-magnetic-clamp-250ml-erlenmeyer>: HTTP status code is not handled or not allowed
2026-01-10 18:14:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inkcart-cli-251-gy>: HTTP status code is not handled or not allowed
2026-01-10 18:14:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digital-hotplate-magnetic-stirrer-7x7>: HTTP status code is not handled or not allowed
2026-01-10 18:14:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-24wx14dx60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:14:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/74hb40-75-keyed-alike-lockout-padlock-non-conductive-3-inch-shackle-green-06775>: HTTP status code is not handled or not allowed
2026-01-10 18:14:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-em3311t-g-3-ph-75-hp-208-230-460-v-1800-rpm-opsb-213t-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:14:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-ehm4103t-5-3-ph-25-hp-575-v-1770-rpm-tefc-284t-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:14:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7e-mach-rod-end-machined-black-oxided-c1030-1035-3-4-10-x-6>: HTTP status code is not handled or not allowed
2026-01-10 18:14:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelon-42w-x-24d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:14:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-54w-x-21d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:14:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-stock-23-gallon-tank-gct21s-22-l-x-22-w-x-28-h-price-each>: HTTP status code is not handled or not allowed
2026-01-10 18:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/bins_totes_containers/liquid_storage_tanks/storage_drums_barrels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:14:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-24w-x-14d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:14:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-w-x-30-d-maple-butcher-block-square-edge-workbench-adjustable-height-black>: HTTP status code is not handled or not allowed
2026-01-10 18:14:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machined-chrome-steel-needle-roller-bearing-w-inner-ring-12-x-24-x-22mm>: HTTP status code is not handled or not allowed
2026-01-10 18:14:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machined-chrome-steel-needle-roller-bearing-w-inner-ring-95-x-125-x-36mm>: HTTP status code is not handled or not allowed
2026-01-10 18:14:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4020sw-direct-drive-walking-foot-sewing-machine>: HTTP status code is not handled or not allowed
2026-01-10 18:14:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lifting-magnet-motor-dmg2333-33-hp-1750-rpm-dpfg-328at-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:14:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-steel-stock-cart-36-x-24-800-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:14:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-42wx18dx80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:14:44 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/bins_totes_containers/liquid_storage_tanks/storage_drums_barrels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/bins_totes_containers/liquid_storage_tanks/storage_drums_barrels landed on page that is not a product page.
2026-01-10 18:14:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vl-san-giorgio-vsmk10am-vsg-life-jacket-solas-med-orange-adult-oversize>: HTTP status code is not handled or not allowed
2026-01-10 18:14:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultratech-gloves-nitrile-cut-a4-impact-1-abrasion-4-puncture-4-gray-black-l>: HTTP status code is not handled or not allowed
2026-01-10 18:14:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-1-4-20-transfer-screw-set>: HTTP status code is not handled or not allowed
2026-01-10 18:14:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultratech-gloves-13-gauge-nylon-shell-nitrile-palm-fingers-tpr-back-red-black-2xl>: HTTP status code is not handled or not allowed
2026-01-10 18:14:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ninja-bnf-gloves-15-gauge-nylon-nitrile-coated-palm-fingertips-gray-black-s>: HTTP status code is not handled or not allowed
2026-01-10 18:14:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dc-scr-nema-4x-control-accessory-bc145-signal-isolator-board>: HTTP status code is not handled or not allowed
2026-01-10 18:14:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/line-regenerative-dc-control-accessory-bc215-bipolar-signal-isolator-board>: HTTP status code is not handled or not allowed
2026-01-10 18:14:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-hole-pegboard-strip-18Wx45H-white-epoxy>: HTTP status code is not handled or not allowed
2026-01-10 18:14:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blower-and-mounting-kit-for-dc-intergral-hp-motor-cat-no-ending-in-p-fvb8500-504-506-motor-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:14:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-48w-x-14d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:14:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/azle-shampoo-chair>: HTTP status code is not handled or not allowed
2026-01-10 18:14:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-60w-x-21d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:14:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awn-rn22-4bb-window-entry-awning-4-4-1-2-w-x-2d-x-2-7-h-bright-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:15:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awn-cn44-5k-window-entry-awning-5-4-1-2-w-x-4d-x-4-8-h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:15:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-acting-hydraulic-cylinder-30-ton-8-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:15:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/main-support-poles-for-cabinet-41800-and-42000>: HTTP status code is not handled or not allowed
2026-01-10 18:15:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-ac-motor-c-face-kit-field-conversion-10-1305gld-tefc-10-284-6uc-tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:15:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-24w-x-18d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:15:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelon-54w-x-14d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:15:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-60w-x-18d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:15:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bubblefoampoly-disppenser-floor-unit-double-arm-w-slide-cutter-36-material-width-51l>: HTTP status code is not handled or not allowed
2026-01-10 18:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/pneumatic_hoses_connectors/pneumatic_quick_connect_couplings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:15:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/windlass-tensioner-economy-steel-34-1-14-strap-width-023-to-031-strap-gauge>: HTTP status code is not handled or not allowed
2026-01-10 18:15:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7077 pages (at 93 pages/min), scraped 2989 items (at 43 items/min)
2026-01-10 18:15:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waring-wfp14s-food-processor-commercial-liquilock-seal-system-3-1-2-quarts>: HTTP status code is not handled or not allowed
2026-01-10 18:15:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/celltreat-scientific-products-250l-pipette-tips-mla-stacked-dense-rack-nonsterile-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:15:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ibc-steel-spill-pallet-9469-bd>: HTTP status code is not handled or not allowed
2026-01-10 18:15:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-30w-x-14d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:15:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-sided-freestanding-gear-storage-locker-fss-10-24-ten-24-sections-chrome>: HTTP status code is not handled or not allowed
2026-01-10 18:15:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/w5617-10-cimeter-knife-white-handle-10>: HTTP status code is not handled or not allowed
2026-01-10 18:15:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90009-meat-tenderizer-red-6-count>: HTTP status code is not handled or not allowed
2026-01-10 18:15:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/pneumatic_hoses_connectors/pneumatic_quick_connect_couplings>: HTTP status code is not handled or not allowed
2026-01-10 18:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/definite_purpose_electric_motors/vertical_hollow_shaft_motors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:15:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spoons-heavy-medium-weight-plastic-shatter-resistant-1000-carton-black>: HTTP status code is not handled or not allowed
2026-01-10 18:15:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rectangular-table-cover-plastic-40w-x-300l-1-roll-white>: HTTP status code is not handled or not allowed
2026-01-10 18:15:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stirrers-7l-wooden-1000-pack-wood>: HTTP status code is not handled or not allowed
2026-01-10 18:15:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omnicart-cab-30-cap-w-locking-panel-woodgrain-49-3-4w-x-17d-x-43-3-4h>: HTTP status code is not handled or not allowed
2026-01-10 18:15:24 [py.warnings] (PID: 62) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2026-01-10 18:15:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cutlery-combo-forks-knives-spoons-napkins-250-carton-white>: HTTP status code is not handled or not allowed
2026-01-10 18:15:25 [scrapy.extensions.feedexport] (PID: 62) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:3
2026-01-10 18:15:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n-ferno-6477-cold-storage-thermal-insulated-bib-overalls-2xl-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:15:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/celltreat-scientific-products-5ml-pipette-tips-ovation-graduated-vistaclear-box-sterile-60-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:15:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-153-automatic-air-freshener-refills-lemon-7-oz-can-12-refills-case>: HTTP status code is not handled or not allowed
2026-01-10 18:15:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rcl-307-top-push-roller>: HTTP status code is not handled or not allowed
2026-01-10 18:15:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/definite_purpose_electric_motors/vertical_hollow_shaft_motors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/definite_purpose_electric_motors/vertical_hollow_shaft_motors landed on page that is not a product page.
2026-01-10 18:15:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lzws-lrpbm8k-filtered-bottle-filling-station-w-integral-refrig-fountain>: HTTP status code is not handled or not allowed
2026-01-10 18:15:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-180-manway-gasket-1158-x-1558-x-1114-black-rubber-obround-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:15:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-1675-back-support-brace-with-coolingwarming-pack-2xl-black>: HTTP status code is not handled or not allowed
2026-01-10 18:15:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-e-a-decking-shoring-beam-857-966-long>: HTTP status code is not handled or not allowed
2026-01-10 18:15:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jurni-multi-purpose-table-with-post-legs--casters-60l-x-24w-x-29h-columbian-walnut>: HTTP status code is not handled or not allowed
2026-01-10 18:15:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16002p-16-000-watts-pto-avr-generator-kit>: HTTP status code is not handled or not allowed
2026-01-10 18:15:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-180-handhole-gasket-6-x-8-x-1-black-rubber-elliptical-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:15:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jurni-multi-purpose-table-with-post-legs--casters-72l-x-24w-x-29h-columbian-walnut>: HTTP status code is not handled or not allowed
2026-01-10 18:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/hydraulics/hydraulic_motor_parts/hydraulic_motor_clamps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:15:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twin-series-clamp-for-hose-tsch038-3-8-inch-id-0777-od>: HTTP status code is not handled or not allowed
2026-01-10 18:15:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/western-global-fuelcube-type-s-diesel-fuel-storage-tank-w-12v15gpm-pump-kit-119-gal-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:15:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cep-94132-100-142-sjtw-string-light-plastic-guards>: HTTP status code is not handled or not allowed
2026-01-10 18:15:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ex20-100c-15-sw-portable-carpet-extractor-56105416>: HTTP status code is not handled or not allowed
2026-01-10 18:15:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simpson-replacement-spray-nozzles-rated-up-to-3600-psi-orifice-size-30>: HTTP status code is not handled or not allowed
2026-01-10 18:15:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simpson-aaa173-triplex-pump-kit-3200-psi-28-gpm>: HTTP status code is not handled or not allowed
2026-01-10 18:15:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filter-head-fh325-1-1-2-inch-npt-25-psi-bypass>: HTTP status code is not handled or not allowed
2026-01-10 18:15:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/achim-interlocking-foam-anti-fatigue-floor-tiles-24-x-24-walnut-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:15:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bg9-belt-guard-fits-reducer-styles-smr9-or-wsmr9>: HTTP status code is not handled or not allowed
2026-01-10 18:15:48 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/hydraulics/hydraulic_motor_parts/hydraulic_motor_clamps> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/hydraulics/hydraulic_motor_parts/hydraulic_motor_clamps landed on page that is not a product page.
2026-01-10 18:15:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bg10-belt-guard-fits-reducer-style-smr10>: HTTP status code is not handled or not allowed
2026-01-10 18:15:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/achim-nexus-self-adhesive-vinyl-floor-tile-12-x-12-mosaic-20-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:15:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-motor-cm002p-2-bolt-317-cipr-969-max-rpm-28-displacement>: HTTP status code is not handled or not allowed
2026-01-10 18:15:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smr915rbkit-rebuild-kit-for-an-original-style-shaft-mount-reducer-smr9-151>: HTTP status code is not handled or not allowed
2026-01-10 18:15:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-series-clamp-for-hose-ssch100-1-inch-id-1531-od>: HTTP status code is not handled or not allowed
2026-01-10 18:15:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-bolt-clamp-hc400-4-inch-nominal-dia-378-inch-min-dia-409-inch-max-dia>: HTTP status code is not handled or not allowed
2026-01-10 18:15:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10wtbk-31516-tapered-bushing-kit-3-1516-fits-reducer-style-smr10>: HTTP status code is not handled or not allowed
2026-01-10 18:15:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/achim-nexus-self-adhesive-vinyl-floor-tile-12-x-12-quartose-granite-20-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:15:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smr3-151-shaft-mount-reducer-size-3-151-ratio-2-316-tapered-bore>: HTTP status code is not handled or not allowed
2026-01-10 18:16:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/salamander-heater-electric-wall-mount-fan-forced-208v-15-kw-3-phase-41-7-amps>: HTTP status code is not handled or not allowed
2026-01-10 18:16:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stamped-welding-flange-fs125-1-1-4-inch-steel-2868-inch-od-0134-inch-thick>: HTTP status code is not handled or not allowed
2026-01-10 18:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/first_aid_wound_treatment/bandages_dressings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-cotton-jacket-w-reflective-stripes-hi-vis-orange-l>: HTTP status code is not handled or not allowed
2026-01-10 18:16:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forged-welding-flange-fssw100-1-inch-stainless-steel-2317-inch-od-0134-inch-thick>: HTTP status code is not handled or not allowed
2026-01-10 18:16:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/techstar-sos-storage-bin-5-1-2-cu-ft-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:16:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reducer-bushing-h3109x12x8-3-4-inch-x-1-2-inch-npt-male-to-female>: HTTP status code is not handled or not allowed
2026-01-10 18:16:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/husky-pallet-rack-solid-beam-60x3-regular-duty>: HTTP status code is not handled or not allowed
2026-01-10 18:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_cabinets_pedestals already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metro-extra-shelf-for-open-wire-shelving-30x24>: HTTP status code is not handled or not allowed
2026-01-10 18:16:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7171 pages (at 94 pages/min), scraped 3030 items (at 41 items/min)
2026-01-10 18:16:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pops-assorted-flavors-individually-wrapped-300-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:16:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lbw-portable-kerosene-heater-tradesman-k170-170k-btu-1-or-2-fuel-oil>: HTTP status code is not handled or not allowed
2026-01-10 18:16:12 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/first_aid_wound_treatment/bandages_dressings> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/first_aid_wound_treatment/bandages_dressings landed on page that is not a product page.
2026-01-10 18:16:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lbw-portable-gas-heater-tradesman-400-250k-400k-btu-lpg>: HTTP status code is not handled or not allowed
2026-01-10 18:16:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-long-sleeve-button-down-work-shirt-xl-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:16:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worldwide-electric-winl67-3-5-1-182tc-helical-inline-speed-reducer-182tc-input-flange-3-5-1-ratio>: HTTP status code is not handled or not allowed
2026-01-10 18:16:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hickory-half-zip-pull-over-long-sleeve-shirt-s-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:16:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worldwide-electric-winl137-40-1-284-6tchelical-inline-speed-reducer284-6tc-input-flange40-1-ratio>: HTTP status code is not handled or not allowed
2026-01-10 18:16:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-port-high-pressure-ball-valve-hbv3w038-5800-max-pressure-3-8-inch-nptf>: HTTP status code is not handled or not allowed
2026-01-10 18:16:19 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_cabinets_pedestals> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_cabinets_pedestals landed on page that is not a product page.
2026-01-10 18:16:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/full-zip-hooded-sweater-indura-flame-resistant-11-oz-m-tall-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worldwide-electric-winl147-4-1-405tc-helical-inline-speed-reducer-405tc-input-flange-4-1-ratio>: HTTP status code is not handled or not allowed
2026-01-10 18:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snap-button-down-long-sleve-work-shirt-l-tall-black>: HTTP status code is not handled or not allowed
2026-01-10 18:16:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-long-sleeve-button-down-work-shirt-2xl-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:16:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ds-247050w-shrink-wrap-24w-x-50l-7mil-white>: HTTP status code is not handled or not allowed
2026-01-10 18:16:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-vis-long-sleeve-shirt-tear-and-rip-resistant-m-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ds-267160w-shrink-wrap-26w-x-160l-7mil-white>: HTTP status code is not handled or not allowed
2026-01-10 18:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/foam/foam_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-long-sleeve-button-down-work-shirt-3xl-green>: HTTP status code is not handled or not allowed
2026-01-10 18:16:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wind-pro-full-zip-hooded-sweater-reflective-flame-resistant-3xl-tall-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:16:30 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts landed on page that is not a product page.
2026-01-10 18:16:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-sleeve-henley-interlock-knit-flame-resistant-m-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:16:31 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:16:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5409800-36x18-shelf>: HTTP status code is not handled or not allowed
2026-01-10 18:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/monitor-riser-black>: HTTP status code is not handled or not allowed
2026-01-10 18:16:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/view-adjust-floor-stand-reference-organizer-10-panel>: HTTP status code is not handled or not allowed
2026-01-10 18:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electrical-box-dec-1-c2-series-15a-6-outlets-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:16:36 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts landed on page that is not a product page.
2026-01-10 18:16:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72706tb1-6-mini-srd-twin-leg-carabiner-steel-snap-hooks>: HTTP status code is not handled or not allowed
2026-01-10 18:16:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-media-bollard-black-with-rubber-base-sspb>: HTTP status code is not handled or not allowed
2026-01-10 18:16:37 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/foam/foam_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/foam/foam_sheets landed on page that is not a product page.
2026-01-10 18:16:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-galvanized-steel-shelving-189951>: HTTP status code is not handled or not allowed
2026-01-10 18:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/hvac/fans_blowers/cooling_fans/home_office_fans already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vented-plastic-shelving-60x21x54-nexelon-finish-331480N>: HTTP status code is not handled or not allowed
2026-01-10 18:16:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5651000-sase-shlvg-72x18x74-starter>: HTTP status code is not handled or not allowed
2026-01-10 18:16:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts>: HTTP status code is not handled or not allowed
2026-01-10 18:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/activity-tables-36-l-x-36-w-standard-height-square-white>: HTTP status code is not handled or not allowed
2026-01-10 18:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:16:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-54w-x-32l-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:16:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-32w-x-33l-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:16:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-44w-x-29l-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:16:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-40w-x-33l-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:16:49 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/hvac/fans_blowers/cooling_fans/home_office_fans> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/hvac/fans_blowers/cooling_fans/home_office_fans landed on page that is not a product page.
2026-01-10 18:16:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-30-x-14-3-shelf-media-stand-chrome>: HTTP status code is not handled or not allowed
2026-01-10 18:16:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/allux-series-mailbox-allux-800-wall-mount-mail-parcel-box-in-grey>: HTTP status code is not handled or not allowed
2026-01-10 18:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:16:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-regular-slotted-single-wall-corrugated-box-12-x-12-x-8-275-lb-ect-44-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/friedrich-packaged-terminal-air-conditioner12000-btu-cool-292280>: HTTP status code is not handled or not allowed
2026-01-10 18:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/450hs-34-inch-top-chest-6-drawer-black-34-inch-l-x-27-inch-h-x-25-inchd>: HTTP status code is not handled or not allowed
2026-01-10 18:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/sockets_bits/impact_sockets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:16:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-poly-vinyl-long-bag-black-42-e>: HTTP status code is not handled or not allowed
2026-01-10 18:17:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/450hs-50-inch-top-chest-8-drawer-blue-50-inch-l-x-27-inch-h-x-25-inchd>: HTTP status code is not handled or not allowed
2026-01-10 18:17:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-38w-x-30l-black>: HTTP status code is not handled or not allowed
2026-01-10 18:17:02 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:17:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-34w-x-32l-black>: HTTP status code is not handled or not allowed
2026-01-10 18:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-48w-x-33l-black>: HTTP status code is not handled or not allowed
2026-01-10 18:17:05 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:17:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manchester-stucco-locking-column-mailbox-in-burnt-tuscan-w-decorative-fleur-de-lis-door-in-bronze>: HTTP status code is not handled or not allowed
2026-01-10 18:17:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manchester-stucco-locking-column-mailbox-in-slate-gray-w-decorative-fleur-de-lis-door-in-bronze>: HTTP status code is not handled or not allowed
2026-01-10 18:17:06 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:17:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:17:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/sockets_bits/impact_sockets>: HTTP status code is not handled or not allowed
2026-01-10 18:17:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dry-erase-activity-pocket-chart-14-rows-13-inch-x-34-inch-purple>: HTTP status code is not handled or not allowed
2026-01-10 18:17:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7254 pages (at 83 pages/min), scraped 3052 items (at 22 items/min)
2026-01-10 18:17:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b2020-oh-needle-bearing-drawn-cup-full-complement-oil-hole-bore-3175mm>: HTTP status code is not handled or not allowed
2026-01-10 18:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wood-tape-holder-holds-8-rolls-natural>: HTTP status code is not handled or not allowed
2026-01-10 18:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:17:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/el11204-25hp-48-frame-1200rpm-115-230v-odp-rigid-premium-efficiency>: HTTP status code is not handled or not allowed
2026-01-10 18:17:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kem30003-25hp-1800rpm-56c-frame-3ph-230-460v-odp-c-face-footless-premium-efficiency>: HTTP status code is not handled or not allowed
2026-01-10 18:17:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colorful-sparkle-smiles-superspots-stickers-value-pack-1300-stickers-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:17:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-52w-x-33l-green>: HTTP status code is not handled or not allowed
2026-01-10 18:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ex308-319b-air-scaler-needles-copper-beryllium-set-of-19>: HTTP status code is not handled or not allowed
2026-01-10 18:17:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-eco-sport-1-interlocking-flooring-tiles-1-x-20-x-20-12-pack-coal-1>: HTTP status code is not handled or not allowed
2026-01-10 18:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:17:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:17:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/727e-cup-glass-washer-high-temperature-with-built-in-booster-16-x-16-rack>: HTTP status code is not handled or not allowed
2026-01-10 18:17:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-56w-x-29l-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:17:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-60w-x-34l-black>: HTTP status code is not handled or not allowed
2026-01-10 18:17:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stock-tank-w-155b-w-series-155-gal>: HTTP status code is not handled or not allowed
2026-01-10 18:17:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stocktank-feedbunk-w-ser-75-g-beige>: HTTP status code is not handled or not allowed
2026-01-10 18:17:27 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:17:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/water-tank-brass-float-valve>: HTTP status code is not handled or not allowed
2026-01-10 18:17:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:17:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-52w-x-33l-tan>: HTTP status code is not handled or not allowed
2026-01-10 18:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pocket-cargo-pants-heavy-duty-twill-48w-x-34l-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:17:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-ghs2032al2-corrosive-ghs-label-paper-2-x-2-250-roll>: HTTP status code is not handled or not allowed
2026-01-10 18:17:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-ghs2062al2-compressed-air-ghs-label-paper-2-x-2-250-roll>: HTTP status code is not handled or not allowed
2026-01-10 18:17:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qvc-quick-valve-change-tool-51025>: HTTP status code is not handled or not allowed
2026-01-10 18:17:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-work-coveralls-52-tall-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pocket-cargo-pants-heavy-duty-twill-42w-x-30l-dark-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:17:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-steering-handle-for-2000-lb-cap-wesco-hevimover-987822>: HTTP status code is not handled or not allowed
2026-01-10 18:17:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-jeans-indura-denim-14-oz-34w-x-unhemmed-flame-resistant-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:17:40 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:17:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/19953-spatula-offset-high-carbon-steel-white-handle-5-l>: HTTP status code is not handled or not allowed
2026-01-10 18:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stock-sounder-curtain-w-hardware-1410w-x-10h-beige>: HTTP status code is not handled or not allowed
2026-01-10 18:17:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15303c-cooks-style-paring-knife-blue-handle-high-carbon-steel-3-1-4-l>: HTTP status code is not handled or not allowed
2026-01-10 18:17:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-three-tier-locker-2-wide-12w-x-12d-x-24h-assembled-black>: HTTP status code is not handled or not allowed
2026-01-10 18:17:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-mesh-baskets-14x14x8-price-each-for-qty-3>: HTTP status code is not handled or not allowed
2026-01-10 18:17:46 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:17:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-work-coverall-with-leg-zippers-50-regular-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:17:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-westex-42w-x-32l-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-steelepoxy-s-5-52345-2-1-oz-tubes>: HTTP status code is not handled or not allowed
2026-01-10 18:17:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-performance-200-series-lan-station-african-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 18:17:51 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:17:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-performance-300-series-lan-station-african-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 18:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/medical_supply_carts/acute_care_carts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-work-pants-reflective-material-flame-resistant-42w-x-30l-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:17:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/linen-control-center-no-hanging-bar-or-shelf-trun-knob-silver-vein-w-turn-knob-lock>: HTTP status code is not handled or not allowed
2026-01-10 18:17:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/remp-020201-rubber-eva-pads-2-l-x-2-w-x-7-8-h>: HTTP status code is not handled or not allowed
2026-01-10 18:17:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-compartment-hanging-garment-dispenser-locker-silver-vein-w-turn-knob-locks>: HTTP status code is not handled or not allowed
2026-01-10 18:17:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-westex-35w-x-unhemmed-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:17:58 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:17:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b158k-v-belt-kevlar-5-8-x-161>: HTTP status code is not handled or not allowed
2026-01-10 18:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:18:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-top-threshold-11056-36-inch-silver>: HTTP status code is not handled or not allowed
2026-01-10 18:18:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-sheeting-vinyl-clear-film-04762-clear-36-inch-x-25-foot>: HTTP status code is not handled or not allowed
2026-01-10 18:18:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-low-threshold-w-vinyl-seal-08086-32-inch-silver>: HTTP status code is not handled or not allowed
2026-01-10 18:18:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:18:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-westex-33w-x-32l-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:18:04 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/medical_supply_carts/acute_care_carts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/medical_supply_carts/acute_care_carts landed on page that is not a product page.
2026-01-10 18:18:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-westex-34w-x-30l-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:18:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/attic-armour-43251-white-48-inch-x-48-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:18:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-threshold-w-vinyl-seal-09043-36-inch-brite-gold>: HTTP status code is not handled or not allowed
2026-01-10 18:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:18:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-jeans-basket-weave-flame-resistant-8-oz-42w-x-unhemmed-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:18:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:18:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7342 pages (at 88 pages/min), scraped 3081 items (at 29 items/min)
2026-01-10 18:18:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-jeans-basket-weave-flame-resistant-8-oz-48w-x-34l-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:18:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-steel-sheet-57836-36-inchl-x-24-inchw-x-28-ga>: HTTP status code is not handled or not allowed
2026-01-10 18:18:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-flat-bar-60715-48-inchl-x-2-inchw-x-1-8-inchh-silver-d0283>: HTTP status code is not handled or not allowed
2026-01-10 18:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:18:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wallbase-dry-back-75259-48-inchl-x-4-inchw-beige>: HTTP status code is not handled or not allowed
2026-01-10 18:18:16 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:18:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-westex-54w-x-36l-black>: HTTP status code is not handled or not allowed
2026-01-10 18:18:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cargo-pants-with-double-reinforced-knees-flame-resistant-42w-x-unhemmed-black>: HTTP status code is not handled or not allowed
2026-01-10 18:18:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelving-54-inch-w-x-24-inch-d-x-54-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 18:18:18 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:18:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rd812nh-rotary-hinged-vane-pump-portable-8-gpm-multiple-mounting-options>: HTTP status code is not handled or not allowed
2026-01-10 18:18:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelving-add-on-24-inch-w-x-14-inch-d-x-54-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 18:18:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:18:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelving-add-on-48-inch-w-x-14-inch-d-x-63-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 18:18:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:18:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/assy-es-s4872-ramp-trim-kit-fits-48-x-72-mat>: HTTP status code is not handled or not allowed
2026-01-10 18:18:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-westex-54w-x-32l-tan>: HTTP status code is not handled or not allowed
2026-01-10 18:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/painting_supplies/spray_paint_primer already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:18:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelving-add-on-36-inch-w-x-14-inch-d-x-74-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 18:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:18:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-54w-x-24d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 18:18:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-36w-x-21d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:18:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cargo-pants-with-double-reinforced-knees-flame-resistant-40w-x-30l-black>: HTTP status code is not handled or not allowed
2026-01-10 18:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:18:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-30w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:18:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-9a-3ph-remote-start-start-stop-24-60v-1-7-2-3a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-9a-3ph-remote-start-start-stop-100-250v-5-7-7-6a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-48w-x-21d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 18:18:37 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-supplies/painting_supplies/spray_paint_primer> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-supplies/painting_supplies/spray_paint_primer landed on page that is not a product page.
2026-01-10 18:18:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-9a-3ph-start-stop-24-60v-3-1-4-2a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:38 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:18:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-24w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:18:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-9a-1ph-remote-start-start-stop-24-60v-4-2-5-7a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:41 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:18:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nestable-plastic-shelf-bin-6-5-8w-x-11-5-8d-x-8h-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:18:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 18:18:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-12a-3ph-start-stop-24-60v-4-2-5-7a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-12w-x-36d-x-39h-with-12-8h-plastic-shelf-bins-red>: HTTP status code is not handled or not allowed
2026-01-10 18:18:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ez-gld-2-fixed-drp-dn-lad-rack-for-comp-long-2265-3-01>: HTTP status code is not handled or not allowed
2026-01-10 18:18:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-12a-1ph-reset-button-24-60v-3-1-4-2a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cross-member-high-roof-full-size-van-2056-3>: HTTP status code is not handled or not allowed
2026-01-10 18:18:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/economy-fastener-hfef150-stalguardcoated-steel-anticorrosive-150pk>: HTTP status code is not handled or not allowed
2026-01-10 18:18:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-12a-1ph-separate-coil-voltage-reset-button-100-250v-4-2-5-7a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-16a-3ph-start-stop-24-60v-4-2-5-7a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/56fsl-3-personfloor-mount-wash-station-with-double-foot-pedal-valves>: HTTP status code is not handled or not allowed
2026-01-10 18:18:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deep-groove-ball-bearings-metric-6306-2rs-2-rubber-seals-heavy-duty-30mm-bore-72mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:18:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-8482-outdoor-metal-slatted-receptacle-w-access-door-rain-bonnet-lid-36-gallon-green>: HTTP status code is not handled or not allowed
2026-01-10 18:18:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-16a-1ph-remote-start-terminals-start-stop-100-250v-13-16a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-16a-1ph-remote-start-reset-button-100-250v-13-16a>: HTTP status code is not handled or not allowed
2026-01-10 18:18:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-26a-3ph-direct-online-reset-button-100-250v-13-16a>: HTTP status code is not handled or not allowed
2026-01-10 18:19:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-26a-1ph-direct-online-start-stop-100-250v-16-20a>: HTTP status code is not handled or not allowed
2026-01-10 18:19:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rhino-34-white-flexible-nylon-labels>: HTTP status code is not handled or not allowed
2026-01-10 18:19:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-38a-3ph-direct-online-start-stop-250-500v-20-24a>: HTTP status code is not handled or not allowed
2026-01-10 18:19:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rhino-12-blue-vinyl-tape-white-print>: HTTP status code is not handled or not allowed
2026-01-10 18:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/nuts/lock_nuts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:19:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/332035-hex-machine-screw-nut-4-40-low-carbon-steel-plain-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/screws/ball_point_socket_set_screws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:19:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d79ap-osha-sign-danger-no-smoking-3-x-5-whiteredblack>: HTTP status code is not handled or not allowed
2026-01-10 18:19:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-38a-3ph-remote-start-reset-button-250-500v-29-35a>: HTTP status code is not handled or not allowed
2026-01-10 18:19:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7428 pages (at 86 pages/min), scraped 3113 items (at 32 items/min)
2026-01-10 18:19:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-38a-1ph-separate-coil-voltage-start-stop-100-250v-20-24a>: HTTP status code is not handled or not allowed
2026-01-10 18:19:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-mini-split-dual-fan-stand-qsms1202-38l-x-38w-x-12h>: HTTP status code is not handled or not allowed
2026-01-10 18:19:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-compression-spring-06-od-x-0055-x-15-music-wire-pkg-of-5>: HTTP status code is not handled or not allowed
2026-01-10 18:19:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d11rb-osha-sign-danger-safety-glasses-required-in-this-area-10-x-14-whiteredblack>: HTTP status code is not handled or not allowed
2026-01-10 18:19:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d360p-osha-sign-danger-permit-required-confined-space-do-not-enter-7-x-10-whiteredblack>: HTTP status code is not handled or not allowed
2026-01-10 18:19:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-52a-1ph-remote-start-start-stop-100-250v-22-28a>: HTTP status code is not handled or not allowed
2026-01-10 18:19:16 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/fasteners/nuts/lock_nuts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/fasteners/nuts/lock_nuts landed on page that is not a product page.
2026-01-10 18:19:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/fasteners/screws/ball_point_socket_set_screws>: HTTP status code is not handled or not allowed
2026-01-10 18:19:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-52a-1ph-remote-start-reset-button-100-250v-25-33a>: HTTP status code is not handled or not allowed
2026-01-10 18:19:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c525pb-osha-sign-caution-hot-surface-do-not-touch-10-x-14-yellowblack>: HTTP status code is not handled or not allowed
2026-01-10 18:19:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tm145j-traffic-sign-handicapped-parking-only-18-x-12-whitebluegreen>: HTTP status code is not handled or not allowed
2026-01-10 18:19:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-65a-1ph-reset-button-24-60v-57-67a>: HTTP status code is not handled or not allowed
2026-01-10 18:19:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/32-chromebook-8482-laptop-tablet-charging-cart>: HTTP status code is not handled or not allowed
2026-01-10 18:19:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6ft-4ft-sago-palm-double-potted-silk-tree>: HTTP status code is not handled or not allowed
2026-01-10 18:19:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6ft-banana-silk-tree>: HTTP status code is not handled or not allowed
2026-01-10 18:19:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vsm-abrasive-belt-2099-aluminum-oxide-25-x-48-180-grit>: HTTP status code is not handled or not allowed
2026-01-10 18:19:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-exhaust-fan-w-shutter-42-inch-prop-1hp-15455-cfm-3-phase-belt-drive>: HTTP status code is not handled or not allowed
2026-01-10 18:19:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-biometric-rifle-safe-gun-cabinet-13-3-4w-x-13-3-4d-x-57h>: HTTP status code is not handled or not allowed
2026-01-10 18:19:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-powered-audio-visual-cart-lockable-cabinet-40ah-battery-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:19:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/voyager-lightweight-headset-kenwood-hyt-relm-series-radios>: HTTP status code is not handled or not allowed
2026-01-10 18:19:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clean-260-dip-and-splash-ultrasonic-cleaning-solution-7-1-ph-2-5-l>: HTTP status code is not handled or not allowed
2026-01-10 18:19:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ac-inpass-1-inch-npt-2-in-1-coalescing-filter-178-cfm-8-000-hr-0-01-micron-232-psi>: HTTP status code is not handled or not allowed
2026-01-10 18:19:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-polypropylene-tagging-fasteners-803-standard-yellow-3l-5000-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:19:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/satin-nickel-victorian-style-knob-set>: HTTP status code is not handled or not allowed
2026-01-10 18:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/power_tools/power_saws_blades/band_saws/band_saw_blades already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:19:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pioneer-americana-2am401-bn-two-handle-kitchen-faucet-with-spray-pvd-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 18:19:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sae-stubby-combination-wrench-set-9930-11-piece-fully-polished>: HTTP status code is not handled or not allowed
2026-01-10 18:19:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-3q28-clear-storage-tote-with-lid-41-quart-29-l-x-18-w-x-6-h>: HTTP status code is not handled or not allowed
2026-01-10 18:19:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/41-ibc-stairway-stair36i-6-41>: HTTP status code is not handled or not allowed
2026-01-10 18:19:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stht10169-folding-knife-6-1-2-inch-long>: HTTP status code is not handled or not allowed
2026-01-10 18:19:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/82-115-4-piece-pick-and-hook-set>: HTTP status code is not handled or not allowed
2026-01-10 18:19:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/56-ibc-stairway-stair36i-8-56>: HTTP status code is not handled or not allowed
2026-01-10 18:19:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/120-ibc-stairway-stair36i-18-120>: HTTP status code is not handled or not allowed
2026-01-10 18:19:46 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/power_tools/power_saws_blades/band_saws/band_saw_blades> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/power_tools/power_saws_blades/band_saws/band_saw_blades landed on page that is not a product page.
2026-01-10 18:19:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-48-inch-w-x-21-inch-d-x-62-inch-h-2000-lbs-cap-3-open-and-1-solid-grid-shelves>: HTTP status code is not handled or not allowed
2026-01-10 18:19:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tra708-5c-heavy-duty-narrow-crown-staples-1-2-inch-5000-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:19:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/139-osha-stairway-stair36o-16-139>: HTTP status code is not handled or not allowed
2026-01-10 18:19:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-60-inch-w-x-24-inch-d-x-50-inch-h-2000-lbs-cap-4-open-grid-shelves-dunnage-stand>: HTTP status code is not handled or not allowed
2026-01-10 18:19:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/85-ibc-stairway-stair36i-13-85>: HTTP status code is not handled or not allowed
2026-01-10 18:19:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-60-inch-w-x-21-inch-d-x-86-inch-h-2000-lbs-cap-3-open-1-solid-shelf-dunnage-stand>: HTTP status code is not handled or not allowed
2026-01-10 18:19:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bronze-sleeve-bearing-bsb121630-34id-x-1od-178l>: HTTP status code is not handled or not allowed
2026-01-10 18:19:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-72-inch-w-x-18-inch-d-x-62-inch-h-2000-lbs-cap-3-open-1-solid-shelf-dunnage-stand>: HTTP status code is not handled or not allowed
2026-01-10 18:19:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-72-inch-w-x-21-inch-d-x-50-inch-h-2000-lbs-cap-5-open-grid-shelves-dunnage-stand>: HTTP status code is not handled or not allowed
2026-01-10 18:19:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-head-arbors-fhl8x-lefthand-thread-14-arbor-316-shank-dia>: HTTP status code is not handled or not allowed
2026-01-10 18:19:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-frame-folding-tank-alf-500-72l-x-72w-x-29h-500-gallon-cap-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:20:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-shaft-arbor-as5l-righthand-type-d-214l-thread-fits-58-shaft>: HTTP status code is not handled or not allowed
2026-01-10 18:20:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-48-inch-w-x-24-inch-d-x-74-inch-h-2000-lbs-cap-5-solid-shelves>: HTTP status code is not handled or not allowed
2026-01-10 18:20:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-sided-self-supporting-tank-ls-3500-204-dia-x-33h-3500-gallon-cap-green>: HTTP status code is not handled or not allowed
2026-01-10 18:20:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-blade-set-fkz-wire-stripper>: HTTP status code is not handled or not allowed
2026-01-10 18:20:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uni-plus-cable-stripper-8-15mm-common-round-cables>: HTTP status code is not handled or not allowed
2026-01-10 18:20:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drain-pump-system-131-0001-with-m98-pump-1-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 18:20:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-60-inch-w-x-21-inch-d-x-86-inch-h-2000-lbs-cap-4-solid-shelves-dunnage-stand>: HTTP status code is not handled or not allowed
2026-01-10 18:20:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dpg54-2d-ansi-z87-1-protector-smoke>: HTTP status code is not handled or not allowed
2026-01-10 18:20:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/performance-corner-accessory-bar>: HTTP status code is not handled or not allowed
2026-01-10 18:20:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7526 pages (at 98 pages/min), scraped 3159 items (at 46 items/min)
2026-01-10 18:20:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/82868-4-w-x-6-l-tt-z-select-4000t-1-core-5-od>: HTTP status code is not handled or not allowed
2026-01-10 18:20:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-54-inch-w-x-21-inch-d-x-62-inch-h-2000-lbs-cap-4-solid-shelves-dunnage-stand>: HTTP status code is not handled or not allowed
2026-01-10 18:20:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b-rate-depository-safe-front-loading-digital-lock-20w-x-20d-x-30h>: HTTP status code is not handled or not allowed
2026-01-10 18:20:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-foot-rigid-tube-steel-post-bolt-on-style-for-3-ribbed-bolt-on-style-guard-rails-black>: HTTP status code is not handled or not allowed
2026-01-10 18:20:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jib-crane-10x12-1000lb>: HTTP status code is not handled or not allowed
2026-01-10 18:20:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medina-63w-left-curved-desk-return-with-pencil-box-file-pedestal-sea-salt>: HTTP status code is not handled or not allowed
2026-01-10 18:20:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/versatile-4c-mailbox-4c16s-09-56-12h-9-mailboxes-1-parcel-front-loading-brown-usps>: HTTP status code is not handled or not allowed
2026-01-10 18:20:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pump-tf2111-75-hp-243-cfm-175-max-psi>: HTTP status code is not handled or not allowed
2026-01-10 18:20:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calcium-alginate-dressing-2l-x-2w-120-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:20:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jib-crane-6x8-500lb>: HTTP status code is not handled or not allowed
2026-01-10 18:20:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zinc-oxide-ointment-1-oz-tube-pack-of-72>: HTTP status code is not handled or not allowed
2026-01-10 18:20:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-torx-power-bit-16036x-1-4-hexagon-t40-drive-1-15-16-long>: HTTP status code is not handled or not allowed
2026-01-10 18:20:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dynafit-compression-stockings-knee-large-regular-60-pairs>: HTTP status code is not handled or not allowed
2026-01-10 18:20:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sensi-wrap-self-adherent-bandage-rolls-1w-x-5-yards-tan-30-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:20:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deep-throat-forged-body-c-clamp-408-0-8-opening-4-1-2-throat-depth-5900-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:20:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sae-hex-tip-impact-socket-7441-3-8-1-2-drive-3-long-3-8-hex-tip>: HTTP status code is not handled or not allowed
2026-01-10 18:20:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u-sling-wo-head-support-medium>: HTTP status code is not handled or not allowed
2026-01-10 18:20:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u-sling-w-head-support-large>: HTTP status code is not handled or not allowed
2026-01-10 18:20:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterproof-bordered-foam-dressing-6l-x-6w-120-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:20:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-storage-island-twin-w-clear-trays-48w-x-29d-x-29-1-2h-birch-plywood>: HTTP status code is not handled or not allowed
2026-01-10 18:20:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/biopsy-punches-80-mm-purple-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 18:20:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tm15j-traffic-sign-no-parking-any-time-with-right-arrow-18-x-12-white>: HTTP status code is not handled or not allowed
2026-01-10 18:20:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medi-cut-disposable-sterile-scalpels-size-22-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 18:20:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tm098j-traffic-sign-no-standing-anytime-18-x-12-white>: HTTP status code is not handled or not allowed
2026-01-10 18:20:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tms336j-traffic-sign-reserved-parking-texas-sign-24-x-12-white->: HTTP status code is not handled or not allowed
2026-01-10 18:20:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tms334g-traffic-sign-reserved-parking-rhode-island-18-x-12-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:20:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tms316j-traffic-sign-reserved-parking-illinois-24-x-12-white->: HTTP status code is not handled or not allowed
2026-01-10 18:20:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-work-height-platform-truck-w-hardboard-top-30-x-48>: HTTP status code is not handled or not allowed
2026-01-10 18:20:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrow-aisle-order-picking-truck-24-x-48>: HTTP status code is not handled or not allowed
2026-01-10 18:20:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tm99k-traffic-sign-no-parking-here-to-corner-18-x-12-white>: HTTP status code is not handled or not allowed
2026-01-10 18:20:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tmas10g-traffic-sign-violators-will-be-towed-6-x-12-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:20:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-stic-grip-xtra-comfort-ballpoint-pen-black-12mm-medium-36-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:20:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jumbo-refillable-permanent-marker-chisel-tip-red>: HTTP status code is not handled or not allowed
2026-01-10 18:20:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dynarest-airfloat-deluxe-air-mattress-w-perimeter-80l-x-36w-x-11h>: HTTP status code is not handled or not allowed
2026-01-10 18:20:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jojoba-unscented-lotion-1-2-gallon>: HTTP status code is not handled or not allowed
2026-01-10 18:20:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-containment-berm-foam-wall-10-feet-x-10-feet-copolymer-2000-black-green>: HTTP status code is not handled or not allowed
2026-01-10 18:20:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/half-round-bolster-24-5-l-x-6-dia-burgundy>: HTTP status code is not handled or not allowed
2026-01-10 18:20:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-pak-vsl-0832b-temp-pak-includes-low-profile-8-x-32-tempered-glass>: HTTP status code is not handled or not allowed
2026-01-10 18:20:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sl-led-light-bulb-14w-1500-lumens-twist-and-lock-base-dimmable-super-white-6-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:20:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amscope-microscope-ring-light-64-led-w-dimmer>: HTTP status code is not handled or not allowed
2026-01-10 18:20:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amscope-dust-cover-full-size-standard-microscopes-m>: HTTP status code is not handled or not allowed
2026-01-10 18:21:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-square-table-on-casters-with-4-chairs-steel-frame-white-table-w-navy-poly-chairs>: HTTP status code is not handled or not allowed
2026-01-10 18:21:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anatomical-model-shorty-the-mini-skeleton-on-mounted-base>: HTTP status code is not handled or not allowed
2026-01-10 18:21:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anatomical-model-hand-skeleton-with-removable-ligaments-muscles-4-part>: HTTP status code is not handled or not allowed
2026-01-10 18:21:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mc-spark-free-combustible-gas-recovery-machine>: HTTP status code is not handled or not allowed
2026-01-10 18:21:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eco-stackable-storage-cube-natural>: HTTP status code is not handled or not allowed
2026-01-10 18:21:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ct-usa-endurance-open-chest-30-inch-x-17-1-2-inch-midnight-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:21:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexible-pvc-double-impact-door-fdsc700bsm072108-6-w-x-9-h>: HTTP status code is not handled or not allowed
2026-01-10 18:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:21:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fl-casual-work-three-quarter-smooth-leather-cognac-10-5eee>: HTTP status code is not handled or not allowed
2026-01-10 18:21:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7624 pages (at 98 pages/min), scraped 3207 items (at 48 items/min)
2026-01-10 18:21:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inner-ring-for-shell-type-needle-roller-bearing-inch-1-bore-114-od-1308mm-width>: HTTP status code is not handled or not allowed
2026-01-10 18:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:21:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/77300-emery-cloth-shop-rolls-grit-80-1-x-10-yards>: HTTP status code is not handled or not allowed
2026-01-10 18:21:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-24-rack-screws-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:21:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/75302-resin-fiber-disc-3-pak-7-8-arbor-50-grit-7>: HTTP status code is not handled or not allowed
2026-01-10 18:21:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fixed-height-work-table-60l-x-36w-x-30h>: HTTP status code is not handled or not allowed
2026-01-10 18:21:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss304-66010x04-1x12-class-150-hex-bushing-stainless-steel-304>: HTTP status code is not handled or not allowed
2026-01-10 18:21:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sleeping-pillow-standard-firmness-mid-size-22-x-15>: HTTP status code is not handled or not allowed
2026-01-10 18:21:18 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 18:21:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fl-casual-work-three-quarter-nubuck-leather-black-10-5d>: HTTP status code is not handled or not allowed
2026-01-10 18:21:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ia-6-inch-waterproof-work-boot-waterproof-leather-brown-14m>: HTTP status code is not handled or not allowed
2026-01-10 18:21:21 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots landed on page that is not a product page.
2026-01-10 18:21:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/band-ade-band-saw-fluid-68003-5-gallon>: HTTP status code is not handled or not allowed
2026-01-10 18:21:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ia-6-inch-waterproof-work-boot-waterproof-leather-brown-11-5m>: HTTP status code is not handled or not allowed
2026-01-10 18:21:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ia-11-inch-pull-on-workboot-leather-brown-11-5m>: HTTP status code is not handled or not allowed
2026-01-10 18:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/ladders_personnel_lifts/step_ladders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:21:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hbb-separated-combustion-unit-heater-aluminized-steel-exchanger-250000-btu>: HTTP status code is not handled or not allowed
2026-01-10 18:21:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-all-purpose-scrubbing-dish-wand-refills-2-pack-pky-qty-6-1135>: HTTP status code is not handled or not allowed
2026-01-10 18:21:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-varitemp-heat-gun-kit-1200-degrees-f>: HTTP status code is not handled or not allowed
2026-01-10 18:21:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pilot-orifice-018-inch-for-jade-4617900000>: HTTP status code is not handled or not allowed
2026-01-10 18:21:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/burner-valve-for-southbend-1178202>: HTTP status code is not handled or not allowed
2026-01-10 18:21:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ml-a1105-anodized-aluminum-safety-padlock-1-1-2-inchw-1-inchtall-shackle-keyed-alike-red>: HTTP status code is not handled or not allowed
2026-01-10 18:21:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ironcat-heavyweight-top-grain-pigskin-mig-welding-gloves-natural-xl-all-leather>: HTTP status code is not handled or not allowed
2026-01-10 18:21:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-chrome-3-tier-wire-shelving-add-on-unit-36w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 18:21:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/material-handling/ladders_personnel_lifts/step_ladders>: HTTP status code is not handled or not allowed
2026-01-10 18:21:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awa282-1-gym-pe-locker-single-tier-12x18x72-assembled>: HTTP status code is not handled or not allowed
2026-01-10 18:21:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awa282-222-gym-pe-locker-double-tier-36x18x36-assembled>: HTTP status code is not handled or not allowed
2026-01-10 18:21:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u3518-2hv-a-heavy-duty-ventilated-locker-double-tier-15x21x36-6-doors-assembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:21:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bangor-rafting-t-029-054-0018-hardwood-handle-58>: HTTP status code is not handled or not allowed
2026-01-10 18:21:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tsv1260-red-12-x-60-shadow-board-red-vinyl-self-adhesive-tape-roll>: HTTP status code is not handled or not allowed
2026-01-10 18:21:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sa-washer-and-heat-pump-dryer-combo-set-4-prong-white>: HTTP status code is not handled or not allowed
2026-01-10 18:21:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ac-power-supply-psh75a-enclosed-single-75va-120-208-240-277-480-24vac>: HTTP status code is not handled or not allowed
2026-01-10 18:21:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosed-power-control-center-pspw2rb4-4a-breaker-switch-120vac-2-outlets-wires>: HTTP status code is not handled or not allowed
2026-01-10 18:21:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pathcade-barrier-system-w-hip-sheeting-2-side-72-inch-x-3-inch-x-38-inch-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:21:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-chrome-large-capacity-laundry-cart-w-double-pole-rack>: HTTP status code is not handled or not allowed
2026-01-10 18:21:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sliding-door-handle-flush-mount-white>: HTTP status code is not handled or not allowed
2026-01-10 18:21:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-10-bushel-ups-fedex-able-vinyl-basket-truck-red>: HTTP status code is not handled or not allowed
2026-01-10 18:21:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tt-esd-rubber-matting-mt4536-36x50x0080-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:21:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tt-heel-grounder-35mm-red-velcro-1meg>: HTTP status code is not handled or not allowed
2026-01-10 18:21:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tt-extended-coverage-bench-top-ac-ionizer-blower-bfn8412-50-230-cfm>: HTTP status code is not handled or not allowed
2026-01-10 18:21:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-marking-tape-orange-t-shape-25pkg>: HTTP status code is not handled or not allowed
2026-01-10 18:21:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-corner-guard-Heavy-duty-rounded-31-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:21:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-14-bushel-vinyl-basket-truck-all-swivel-casters-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/hvac/fans_blowers/exhaust_fans/bathroom_exhaust_fans already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:21:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-16-bushel-antimicrobial-basket-all-swivel-casters-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:21:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roof-mount-damper-5acc23rd-23-x-23>: HTTP status code is not handled or not allowed
2026-01-10 18:22:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/17-utility-sanitation-hook-rack-4033-pvc-coated-five-2-hooks-green>: HTTP status code is not handled or not allowed
2026-01-10 18:22:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inline-mixed-flow-18-duct-fan-fkd-18xl-230-460-230-460v-6236-cfm>: HTTP status code is not handled or not allowed
2026-01-10 18:22:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fixed-non-ventilated-curb-5acc20fs-20-1-2-square-x-8h-galvanized-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:22:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/td-1-28-gpf-round-bowl-toilet-19-1-8-inch-w-x-26-3-8-inch-d-x-30-11-16-inch-h-bone>: HTTP status code is not handled or not allowed
2026-01-10 18:22:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blower-wheel-10-dia-x-2w-for-southbend-3103902>: HTTP status code is not handled or not allowed
2026-01-10 18:22:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-elk-elk1280-12v-8ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:22:07 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/hvac/fans_blowers/exhaust_fans/bathroom_exhaust_fans> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/hvac/fans_blowers/exhaust_fans/bathroom_exhaust_fans landed on page that is not a product page.
2026-01-10 18:22:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-eagle-picher-cf6v5-5-6v-7ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/guest_chairs/conference_training_chairs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:22:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-interstate-bsl1075-12v-7ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:22:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7716 pages (at 92 pages/min), scraped 3248 items (at 41 items/min)
2026-01-10 18:22:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-power-patrol-sec1075-12v-7ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 18:22:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welding-strip-door-sd14-8-6x8-6w-x-8h-8-amber-tint-pvc>: HTTP status code is not handled or not allowed
2026-01-10 18:22:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-6-diameter-x-15-l-air-chute-w-cap-ring-kpac2421-2>: HTTP status code is not handled or not allowed
2026-01-10 18:22:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/27-series-versatrac-5-1-4height-4-polyolefin-wheel-ball-bearing-swivel-caster>: HTTP status code is not handled or not allowed
2026-01-10 18:22:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-series-7-1-2height-6-torus-wheel-rigid-caster>: HTTP status code is not handled or not allowed
2026-01-10 18:22:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delta-positioning-construction-harness-3xl-dbi-sala-1101660>: HTTP status code is not handled or not allowed
2026-01-10 18:22:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/55-2-nd-20-3-solid-disk-shaped-raw-magnet-79-diameter-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:22:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contactor-30-amp-24v-2-pole>: HTTP status code is not handled or not allowed
2026-01-10 18:22:19 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/guest_chairs/conference_training_chairs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/guest_chairs/conference_training_chairs landed on page that is not a product page.
2026-01-10 18:22:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/900505-wht-plastic-female-form-on-wheeled-plastic-base-60-oah-white>: HTTP status code is not handled or not allowed
2026-01-10 18:22:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heat-pump-high-wall-22-seer-18000-btu-1-5-ton>: HTTP status code is not handled or not allowed
2026-01-10 18:22:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/142726-vertical-top-load-acrylic-sign-holder-4-x-6-acrylic>: HTTP status code is not handled or not allowed
2026-01-10 18:22:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/201l-mixing-check-valve-certified-nsfansi-372>: HTTP status code is not handled or not allowed
2026-01-10 18:22:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/199611-adhesive-back-c-channel-nameplate-8-5-x-3-acrylic>: HTTP status code is not handled or not allowed
2026-01-10 18:22:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/152725-horizontal-double-sided-stand-up-sign-holder-6-x-5-acrylic>: HTTP status code is not handled or not allowed
2026-01-10 18:22:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wern-d-bolt-anchor-5-8-inch-opening-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:22:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/532f-05-model-532f-with-flow-rate-of-05-gpm>: HTTP status code is not handled or not allowed
2026-01-10 18:22:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wern-30-feet-2-man-rope-horizontal-lifeline-w-d-bolt-ratchet>: HTTP status code is not handled or not allowed
2026-01-10 18:22:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/252300-single-pocket-tri-fold-countertop-brochure-holder-4-5-x-7-75-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/lockers/gear_lockers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:22:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wern-aerial-kit-h412002-a111106-c351100-small-duffle-bag>: HTTP status code is not handled or not allowed
2026-01-10 18:22:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-utility-tool-trolley-w-one-drawer-550lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:22:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/556011-acrylic-shelf-for-pegboard-slatwall-20-x-2-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:22:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/556127-small-display-bucket-w-c-channel-for-pegboard-slatwall-5-x-7-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:22:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/703386-gre-4-sided-interlocking-pegboard-display-w-wheels-8-x-40-green-opaque>: HTTP status code is not handled or not allowed
2026-01-10 18:22:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gm-tactical-megamover-72-inch-x-32-inch-gray-8-case>: HTTP status code is not handled or not allowed
2026-01-10 18:22:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700220-blu-12-pegboard-revolving-countertop-display-4-sided-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:22:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-812l-royal-series-3-4-full-flow-wall-mount-faucet-low-lead-compliant>: HTTP status code is not handled or not allowed
2026-01-10 18:22:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/771660-wht-white-pegboard-wall-panel-16-x-60-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:22:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/lockers/gear_lockers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/lockers/gear_lockers landed on page that is not a product page.
2026-01-10 18:22:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vs-dls-overhead-stirrer-system-w-support-stirring-shaft>: HTTP status code is not handled or not allowed
2026-01-10 18:22:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/701238-8-flip-scan-quick-back-0-187-diameter-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:22:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keystock-5-16-x-5-16-x-6-ft-300-series-stainless-steel-plain-undersize-astm-a484>: HTTP status code is not handled or not allowed
2026-01-10 18:22:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keystock-2-x-2-x-3-ft-carbon-steel-plain-undersize-astm-a29>: HTTP status code is not handled or not allowed
2026-01-10 18:22:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inplant-office-vinyl-cov-hdbd-8x10-4-wall-2-lgts-2-dplx-1-door-white>: HTTP status code is not handled or not allowed
2026-01-10 18:22:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/igg-gage-block-set-rectangular-36-pieces>: HTTP status code is not handled or not allowed
2026-01-10 18:22:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/igg-high-precision-double-square-w-6-inch-steel-blade-black>: HTTP status code is not handled or not allowed
2026-01-10 18:22:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hygrade-blue-poly-tarp-mt810-5-mil-8l-x-10w>: HTTP status code is not handled or not allowed
2026-01-10 18:22:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hygrade-heavy-duty-super-cover-poly-tarp-sth1012-10-mil-silverblack-10l-x-12w>: HTTP status code is not handled or not allowed
2026-01-10 18:22:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hygrade-blue-poly-tarp-mt2020-5-mil-20l-x-20w>: HTTP status code is not handled or not allowed
2026-01-10 18:22:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-electric-kit-12x20-inplant-office>: HTTP status code is not handled or not allowed
2026-01-10 18:22:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/igg-tri-point-internal-bore-gauge-ip54-3-5-4-inch-0-001mm-0-00005-inch-accuracy-0-00015-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:22:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zp-morado-super-cleaner-5-gallon-pail-mild-butyl-scent>: HTTP status code is not handled or not allowed
2026-01-10 18:22:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cat-2010sp-ultra-quiet-oil-free-1-hp-2-gal-tank-air-compressor>: HTTP status code is not handled or not allowed
2026-01-10 18:22:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inplant-office-vinyl-cov-drywall-20x20-2-wall-8-lgt-6-dplx-1-dr-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:22:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aware-wear-s721-non-ansi-female-vest-61910-pink-medium>: HTTP status code is not handled or not allowed
2026-01-10 18:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/air_compressors/rotary_screw_air_compressors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:22:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inplant-office-vinyl-cov-hdbd-16x20-4-wall-5-lgts-6-dplx-1-door-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:22:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-cantilever-rack-starter-heavy-duty-2-in-lip-72-in-w-x-82-in-d-120-in-h>: HTTP status code is not handled or not allowed
2026-01-10 18:23:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-m-xtract-5-inch-pneumatic-random-orbital-sander-self-generated-vacuum-3-8-inch-orbit-12000-rpm>: HTTP status code is not handled or not allowed
2026-01-10 18:23:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-storage-container-lid-19-13-16l-x-13-3-8w-x-2-1-4h>: HTTP status code is not handled or not allowed
2026-01-10 18:23:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastek-esd-workstation-organizer-universal-16-7-8l-8-1-8w-x-2-3-8h>: HTTP status code is not handled or not allowed
2026-01-10 18:23:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-plastic-barrier-chain-2-inch-x-100-feet-l-army-tan>: HTTP status code is not handled or not allowed
2026-01-10 18:23:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-2-1-2-inch-medium-duty-reflective-stanchion-kit-w-2-inch-x-50-feet-l-chain-white-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 18:23:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-3-inch-heavy-duty-stowable-stanchion-41-inch-h-white-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 18:23:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pink-cushion-grade-static-dissipative-foam48l-x-40w-x-1-4h>: HTTP status code is not handled or not allowed
2026-01-10 18:23:07 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/air_compressors/rotary_screw_air_compressors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/pneumatic_system_components/air_compressors/rotary_screw_air_compressors landed on page that is not a product page.
2026-01-10 18:23:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-utility-stakes-12-inch-h-safety-orange-pack-of-15>: HTTP status code is not handled or not allowed
2026-01-10 18:23:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-storage-container-23-5-8l-x-13-3-8w-x-10-1-4h>: HTTP status code is not handled or not allowed
2026-01-10 18:23:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7812 pages (at 96 pages/min), scraped 3287 items (at 39 items/min)
2026-01-10 18:23:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-delineator-reflective-chain-kit-w-2-inch-x-40-feet-l-chain-traffic-orange-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 18:23:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-series-swivel-plate-caster-404109929-brk7-polyurethane-with-brake-4dia-600-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:23:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dispensing-jug-118500000-hdpe-20-liters-1-pk-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:23:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-series-swivel-plate-caster-408199339-phenolic-8dia-1250-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:23:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wash-bottle-116420623-ldpe-500ml-capacity-methanol-3-pk-green-cap-wide-mouth>: HTTP status code is not handled or not allowed
2026-01-10 18:23:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acanthus-rosette-ros05x05acrw-5w-x-5h-x-34d>: HTTP status code is not handled or not allowed
2026-01-10 18:23:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emery-panel-moulding-corner-pml15x15em-1534w-x-1534h-x-118d>: HTTP status code is not handled or not allowed
2026-01-10 18:23:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exercise-putty-4-ounce-set-of-6-6-colors>: HTTP status code is not handled or not allowed
2026-01-10 18:23:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-ceiling-medallion-cm12tr-12od-x-3id-x-1d>: HTTP status code is not handled or not allowed
2026-01-10 18:23:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microwaveable-exercise-putty-firm-blue-6-ounce>: HTTP status code is not handled or not allowed
2026-01-10 18:23:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microwaveable-exercise-putty-soft-orange-4-ounce>: HTTP status code is not handled or not allowed
2026-01-10 18:23:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-5-tools-4-x-6-oz-putties-medium-yellow-red-green-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:23:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/balance-system-15-x-18-board-only>: HTTP status code is not handled or not allowed
2026-01-10 18:23:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-x-8-rectangular-balance-board-with-3-and-4-balls>: HTTP status code is not handled or not allowed
2026-01-10 18:23:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skb-2s-stainless-steel-replacement-blade>: HTTP status code is not handled or not allowed
2026-01-10 18:23:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/side-panel-33303-for-18d-designer-wood-locker-without-sloping-hood-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:23:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-floor-tiles-sm002d-195x195-textured-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:23:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15020035-led-corn-lamp-36w-4490-lumens-5000k-medium-e26-100w-hid-replacement>: HTTP status code is not handled or not allowed
2026-01-10 18:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/storage_panels/louvered_panels_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:23:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/styleview-cart-with-lcd-pivot-sla-powered-2-drawers>: HTTP status code is not handled or not allowed
2026-01-10 18:23:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-pe-foam-roller-half-round-6-dia-x-24l>: HTTP status code is not handled or not allowed
2026-01-10 18:23:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-exerciser-large-red-light>: HTTP status code is not handled or not allowed
2026-01-10 18:23:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-exerciser-base-5-bases-and-metal-rack>: HTTP status code is not handled or not allowed
2026-01-10 18:23:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-composite-foam-roller-half-round-6-dia-x-36-case-of-24>: HTTP status code is not handled or not allowed
2026-01-10 18:23:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-exerciser-blue-heavy-10-0838>: HTTP status code is not handled or not allowed
2026-01-10 18:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/physical_therapy/exercise_fitness_equipment/resistance_devices already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:23:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/com-pax-ial-explosion-proof-blower-with-15-duct-canister-9538-15-8-dia-1-3hp-900-cfm>: HTTP status code is not handled or not allowed
2026-01-10 18:23:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ii-durable-edge-disc-947a-2-inch-diameter-tr-80-grit>: HTTP status code is not handled or not allowed
2026-01-10 18:23:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/surface-conditioning-disc-2-inch-dia-tsm-alum-oxide-med-grit>: HTTP status code is not handled or not allowed
2026-01-10 18:23:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/storage_panels/louvered_panels_accessories> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/storage_panels/louvered_panels_accessories landed on page that is not a product page.
2026-01-10 18:23:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wobble-ball-18-diameter-blue-200-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:23:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orange-heavy-duty-hand-cleaner-2-liter-refill-bag-4-case-dia-10992>: HTTP status code is not handled or not allowed
2026-01-10 18:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/work-benches/workbenches_worktables/open_base_workbenches/mobile_open_base_workbenches/standard_duty_mobile_workbenches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:23:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/checkers-industrial-delineator-with-whips-airlines-delfs3obwuni>: HTTP status code is not handled or not allowed
2026-01-10 18:23:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-stp-steel-safe-roll-lad-wgt-act-lock-16-w-exp-stp-org-wa052414x-o>: HTTP status code is not handled or not allowed
2026-01-10 18:23:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21504-z-large-sump-roof-drain-poly-dome-and-4-no-hub-outlet>: HTTP status code is not handled or not allowed
2026-01-10 18:23:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/medical-lab/physical_therapy/exercise_fitness_equipment/resistance_devices>: HTTP status code is not handled or not allowed
2026-01-10 18:23:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6in-x-3-8in-acrylic-mini-roller-covers-12-pack-8-case-6cr038q-12>: HTTP status code is not handled or not allowed
2026-01-10 18:23:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9in-frame-for-a-4in-mini-roller-24-case-4rl-09>: HTTP status code is not handled or not allowed
2026-01-10 18:23:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3in-x-3-8in-high-capacity-foam-mini-roller-3-pack-12-case-3pf038-3pk>: HTTP status code is not handled or not allowed
2026-01-10 18:23:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90615-first-aid-kit-refill-25-person-ansi-compliant-class-a>: HTTP status code is not handled or not allowed
2026-01-10 18:23:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/benchtop-muffle-furnace-with-a1-controller-5-8l-120v>: HTTP status code is not handled or not allowed
2026-01-10 18:23:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/work-benches/workbenches_worktables/open_base_workbenches/mobile_open_base_workbenches/standard_duty_mobile_workbenches> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/work-benches/workbenches_worktables/open_base_workbenches/mobile_open_base_workbenches/standard_duty_mobile_workbenches landed on page that is not a product page.
2026-01-10 18:23:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-screw-pin-anchor-shackle-1-2>: HTTP status code is not handled or not allowed
2026-01-10 18:23:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/riser-tapered-with-carpet-78l-x-18w-x-32h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:23:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20-x-3-4-security-machine-screw-flat-torx-head-18-8-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:23:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-liquid-bag-filter-polypropylene-felt-7-1-8-d-x-32-l-5-micron-plastic-flange-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 18:24:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-liquid-bag-filter-polyester-felt-7-1-8-d-x-16-1-2-l-50-micron-plastic-flange-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 18:24:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-phillips-pin-head-screwdriver>: HTTP status code is not handled or not allowed
2026-01-10 18:24:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x-1-2-security-sheet-metal-screw-flat-phillips-head-18-8-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:24:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-bag-filter-polyester-felt-4-1-8-dia-x-14-l-50-micron-steel-ring-pkg-qty-50>: HTTP status code is not handled or not allowed
2026-01-10 18:24:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-x-2-1-2-security-sheet-metal-screw-flat-phillips-head-18-8-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:24:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-16-balldriver-l-wrench-10903>: HTTP status code is not handled or not allowed
2026-01-10 18:24:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sewn-liquid-bag-filter-polyester-felt-5-1-2-d-x-15-l-1-micron-steel-ring-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 18:24:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15mm-hex-l-wrench-long-12150>: HTTP status code is not handled or not allowed
2026-01-10 18:24:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 7907 pages (at 95 pages/min), scraped 3330 items (at 43 items/min)
2026-01-10 18:24:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locker-six-tier-12x18x12-18-door-ready-to-assemble-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:24:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/booster-seat-15-1-2-inch-w-x-12-inch-d-x-8-inch-h-dual-heights-wide-base-w-seat-belt-drk-gry-single-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:24:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-office-partition-panel-with-partial-window-and-pass-thru-cable-48-1-4w-x-47-1-2h-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:24:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-a-slate-42-corner-hutch>: HTTP status code is not handled or not allowed
2026-01-10 18:24:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/male-w-barb-10mm-x-1-4>: HTTP status code is not handled or not allowed
2026-01-10 18:24:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelf-level-24w-x-18d-chrome>: HTTP status code is not handled or not allowed
2026-01-10 18:24:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelving-48w-x-14d-x-63h-4-shelf-starter-chrome>: HTTP status code is not handled or not allowed
2026-01-10 18:24:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelving-24w-x-14d-x-63h-4-shelf-starter-chrome>: HTTP status code is not handled or not allowed
2026-01-10 18:24:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nilfisk-gm-80-replacement-hepa-filter>: HTTP status code is not handled or not allowed
2026-01-10 18:24:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-pc-long-paddle-with-out-holes-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:24:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultradewatering-bag-oil-and-sediment-model-3feet-x-4feet>: HTTP status code is not handled or not allowed
2026-01-10 18:24:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/battery-connector-din-a320-female-connector-with-70mm-socket-contacts-handle>: HTTP status code is not handled or not allowed
2026-01-10 18:24:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-48-x-30-adj-height-workbench-w-drawer-gray-maple-safety-edge-top>: HTTP status code is not handled or not allowed
2026-01-10 18:24:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/i-compact-stirrer-with-telemodul-20-c-controller-100-240v>: HTTP status code is not handled or not allowed
2026-01-10 18:24:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-add-on-189353gz-54w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 18:24:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multipack-tags-dirty-clean-and-repair-2-5-16w-4-3-4l>: HTTP status code is not handled or not allowed
2026-01-10 18:24:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-189217gz-30w-x-24d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:24:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gojo-hand-soap-dispenser-adx-chrome-black-1250ml-8888-06>: HTTP status code is not handled or not allowed
2026-01-10 18:24:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-workbenchlower-shelf-48-w-x-12-d>: HTTP status code is not handled or not allowed
2026-01-10 18:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:24:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-platform-for-88880025>: HTTP status code is not handled or not allowed
2026-01-10 18:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:24:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-96-w-x-48-d-x-72-h-starter-3-shelf-levels-wood-deck-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/dry_cleaning_laundry_equipment/ironing_boards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:24:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combo-set-garment-vacuum-cubes-sizes-1-large-1-extra-large-1-jumbo-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:24:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-value-max-locker-36-w-x-18-d-x-78-h-729-parchment-double-tier-3-wide-assembled>: HTTP status code is not handled or not allowed
2026-01-10 18:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:24:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-48-w-x-36-d-x-84-h-starter-3-shelf-levels-wood-deck-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:24:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/economy-coil-thread-repair-kit-for-metal-1-2-20-x-15d>: HTTP status code is not handled or not allowed
2026-01-10 18:24:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digital-heating-shaking-drybath-120v-60hz>: HTTP status code is not handled or not allowed
2026-01-10 18:24:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/touch-screen-dry-bath-block-heater-1-block-capacity-100-120v-50-60hz>: HTTP status code is not handled or not allowed
2026-01-10 18:24:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks>: HTTP status code is not handled or not allowed
2026-01-10 18:24:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/earth-self-stick-easel-pad-25w-x-30h-board-2-pk-fl1218207>: HTTP status code is not handled or not allowed
2026-01-10 18:24:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks>: HTTP status code is not handled or not allowed
2026-01-10 18:24:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/legacy-264-modular-racetrack-conference-table-with-3-power-data-grommets-ash-grey>: HTTP status code is not handled or not allowed
2026-01-10 18:24:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/dry_cleaning_laundry_equipment/ironing_boards>: HTTP status code is not handled or not allowed
2026-01-10 18:24:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-letter-board-blacksilver-frame-24w-x-36h-board-let03031810>: HTTP status code is not handled or not allowed
2026-01-10 18:24:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-2-wheel-appliance-truck-750-lb-cap-59in-h-auto-rewind>: HTTP status code is not handled or not allowed
2026-01-10 18:24:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-series-wheel-200003441-3-1-2-x-1-1-4-performa-rubber-3-8-delrin-bushing-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:24:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks>: HTTP status code is not handled or not allowed
2026-01-10 18:24:48 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks landed on page that is not a product page.
2026-01-10 18:24:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-hi-tech-metal-bin-shelving-36-w-x-18-d-x-87-h-725-hallowell-gray-add-on-unit-21-bins>: HTTP status code is not handled or not allowed
2026-01-10 18:24:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-hi-tech-metal-bin-shelving-36-w-x-18-d-x-87-h-725-hallowell-gray-add-on-unit-54-bins>: HTTP status code is not handled or not allowed
2026-01-10 18:24:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alba-pm1part-bo-cubicle-garment-peg-1-hook-1-15-x-1-38-x-4-310-metallic-grey>: HTTP status code is not handled or not allowed
2026-01-10 18:24:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-hi-tech-metal-bin-shelving-36-w-x-12-d-x-87-h-725-hallowell-gray-starter-unit-24-bins>: HTTP status code is not handled or not allowed
2026-01-10 18:24:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ga15vsd-20-hp-variable-speed-rotary-screw-comp-tankless-175-psig3-ph-460vwdryer>: HTTP status code is not handled or not allowed
2026-01-10 18:24:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-96-w-x-24-d-x-72-h-starter-3-shelf-levels-wood-deck-sand>: HTTP status code is not handled or not allowed
2026-01-10 18:24:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locator-4-cryogenic-rack-and-box-system-111-liters>: HTTP status code is not handled or not allowed
2026-01-10 18:24:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eluh311810-gourmet-lustertone-undermount-sink-30-3-4l-x-18-1-2w-x-10d>: HTTP status code is not handled or not allowed
2026-01-10 18:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:24:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/321421-o-ring-2-7-8-od-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 18:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:24:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1211045-tip-crutch-f-7-8-inch-tube-white>: HTTP status code is not handled or not allowed
2026-01-10 18:25:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-48-w-x-36-d-x-96-h-starter-3-shelf-levels-steel-deck-sand>: HTTP status code is not handled or not allowed
2026-01-10 18:25:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1291233-filter-baffle-20x20-ss-he-fmp>: HTTP status code is not handled or not allowed
2026-01-10 18:25:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-96-w-x-48-d-x-72-h-add-on-3-shelf-levels-wood-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/laboratory_heating_cooling/laboratory_incubators already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:25:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alabama-state-flag-4x6-nylon>: HTTP status code is not handled or not allowed
2026-01-10 18:25:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alera-aleva635632mc-valencia-series-bookcase-4-shelves-31-34w-x-14d-x-55h-medium-cherry>: HTTP status code is not handled or not allowed
2026-01-10 18:25:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-1042-21-3-4-inch-x-3-inch-cast-iron-top-broiler-grate>: HTTP status code is not handled or not allowed
2026-01-10 18:25:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kansas-state-flag-3x5-nylon>: HTTP status code is not handled or not allowed
2026-01-10 18:25:07 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks landed on page that is not a product page.
2026-01-10 18:25:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks>: HTTP status code is not handled or not allowed
2026-01-10 18:25:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-72-w-x-24-d-x-96-h-starter-3-shelf-levels-wire-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:25:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8000 pages (at 93 pages/min), scraped 3366 items (at 36 items/min)
2026-01-10 18:25:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alera-alesd216030po-double-pedestal-steel-desk-metal-desk-60w-x-30d-x-29-12h-cherryputty>: HTTP status code is not handled or not allowed
2026-01-10 18:25:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelf-level-for-bulk-storage-rack-72-w-x-36-d-wood-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:25:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/medical-lab/laboratory_heating_cooling/laboratory_incubators>: HTTP status code is not handled or not allowed
2026-01-10 18:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/gym_fitness_equipment/sports_equipment already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:25:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deflect-o-77441-multi-compartment-docuholder-4-compartments-9-14w-x-7d-x-13-12h-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:25:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deflect-o-693645-three-tier-leaflet-holder-6-34w-x-6-1516d-x-13-516h-silver>: HTTP status code is not handled or not allowed
2026-01-10 18:25:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-12-inch-x-20-foot-fertilizer-solution-suction-discharge-hose-assembly-w-m-x-f-aluminum-short-shanks>: HTTP status code is not handled or not allowed
2026-01-10 18:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/credenzas already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:25:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-40-14w-cabinet-12-drawer-174-compart-classic-blue-no-lock>: HTTP status code is not handled or not allowed
2026-01-10 18:25:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1100-lb-cap-low-profile-hydraulic-transmission-jack-41100c>: HTTP status code is not handled or not allowed
2026-01-10 18:25:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/375x4-fcrb03-child-resistant-flat-bags-3-3-4-x-4-5-mil-black-250-case>: HTTP status code is not handled or not allowed
2026-01-10 18:25:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tubing-with-overdoor-pull-down-bar-red-light-1-set>: HTTP status code is not handled or not allowed
2026-01-10 18:25:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omega-tire-cart-300-lbs-capacity-92030>: HTTP status code is not handled or not allowed
2026-01-10 18:25:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/physicianscare-51028-first-aid-antiseptic-towelettes-box-of-25>: HTTP status code is not handled or not allowed
2026-01-10 18:25:23 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/gym_fitness_equipment/sports_equipment> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/gym_fitness_equipment/sports_equipment landed on page that is not a product page.
2026-01-10 18:25:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omega-22-ton-hydraulic-floor-axle-jack-23221cimpact>: HTTP status code is not handled or not allowed
2026-01-10 18:25:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-40-14w-drawer-cabinet6-drawer72-compart-light-gray-individual-lock>: HTTP status code is not handled or not allowed
2026-01-10 18:25:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/credenzas>: HTTP status code is not handled or not allowed
2026-01-10 18:25:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/-expander-blue-heavy>: HTTP status code is not handled or not allowed
2026-01-10 18:25:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-powder-exercise-tubing-pack-6-tubing-easy-yellow-red-green>: HTTP status code is not handled or not allowed
2026-01-10 18:25:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tubing-exerciser-red-22>: HTTP status code is not handled or not allowed
2026-01-10 18:25:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quickflex-welding-cable-202104-025-2-gauge-25-ft-roll>: HTTP status code is not handled or not allowed
2026-01-10 18:25:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-ah21b-black-epoxy-utility-cart-handle-21w>: HTTP status code is not handled or not allowed
2026-01-10 18:25:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2031136-weight-end-assy-for-globe-food-equipment>: HTTP status code is not handled or not allowed
2026-01-10 18:25:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-free-exercise-tubing-red-100-roll-box-10-5722>: HTTP status code is not handled or not allowed
2026-01-10 18:25:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tubing-with-cuff-exerciser-35-circumference-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:25:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-174-restaurant-lunchroom-square-counter-height-table-42-x-42-x-36-h-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 18:25:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unisex-jade-cotton-polyester-fashion-blend-reversible-scrub-pants-size-2xl>: HTTP status code is not handled or not allowed
2026-01-10 18:25:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/light-duty-cable-tie-tool-502900-001-18-50-lb-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 18:25:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/263792-insert-threaded-squaretubing>: HTTP status code is not handled or not allowed
2026-01-10 18:25:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-nylon-cable-ties-502104-100-85-long-100-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:25:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-nylon-cable-ties-502123-050-18-long-50-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:25:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ironwood-3-compartment-open-storage-locker-cactus-star-color-finish>: HTTP status code is not handled or not allowed
2026-01-10 18:25:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-foxx-2hp-ufo-101h2-vertical-bag-dust-collector>: HTTP status code is not handled or not allowed
2026-01-10 18:25:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-powder-exercise-band-pack-4-band-easy-yellow-red-green>: HTTP status code is not handled or not allowed
2026-01-10 18:25:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-3152-f-medium-base-one-piece-keyless-incandescent-lampholder>: HTTP status code is not handled or not allowed
2026-01-10 18:25:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/econoco-non-adjustable-ballet-rack-psbb-41w-x-64h-x-22d-anthracite-grey>: HTTP status code is not handled or not allowed
2026-01-10 18:25:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pink-covered-solid-body-padlock-no-146d>: HTTP status code is not handled or not allowed
2026-01-10 18:25:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-23452-v-snap-in-lamp-support-clip-for-2g11-base-twin-tube-fluorescent-lampholder>: HTTP status code is not handled or not allowed
2026-01-10 18:25:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-free-exercise-band-50-yard-roll-box-5-color-set>: HTTP status code is not handled or not allowed
2026-01-10 18:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/door_window_hardware/door_hinges already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:25:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009901-nut-hex-keps-8-32-for-roundup-food-equipment>: HTTP status code is not handled or not allowed
2026-01-10 18:25:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-free-exercise-band-5-strips-blue-30-strips-box>: HTTP status code is not handled or not allowed
2026-01-10 18:25:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8002521-cast-iron-radiant22-1-2-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:25:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyester-strapping-58w-x-2200l-x-0025-thick-16-x-3-core-black>: HTTP status code is not handled or not allowed
2026-01-10 18:26:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-3019-anystream-vintage-shower-head>: HTTP status code is not handled or not allowed
2026-01-10 18:26:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1831128-link-belt-1-2-inch-pitch-for-roundup-food-equipment>: HTTP status code is not handled or not allowed
2026-01-10 18:26:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fieldpro-purofort-full-safety-boots-steel-toe-15h-size-11-green>: HTTP status code is not handled or not allowed
2026-01-10 18:26:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exercise-band-loop-10-long-gold-10-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:26:04 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/fasteners/door_window_hardware/door_hinges> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/fasteners/door_window_hardware/door_hinges landed on page that is not a product page.
2026-01-10 18:26:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forklift-pallet-stand-24w-x-36d-x-34h-4-cylinder-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:26:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/barnstead-full-size-ultrapure-cartridge-d8911-1-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:26:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-welded-frame-mirror-18-w-x-30-h>: HTTP status code is not handled or not allowed
2026-01-10 18:26:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/barnstead-cation-removal-cartridge-d0815-full-size-1-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:26:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylinder-tube-rack-4-wide-x-4-deep-58w-x-50d-x-30h16-cylinder-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:26:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8095 pages (at 95 pages/min), scraped 3409 items (at 43 items/min)
2026-01-10 18:26:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-double-robe-hook-bright-polished>: HTTP status code is not handled or not allowed
2026-01-10 18:26:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pentaview-lcd-digital-microscope>: HTTP status code is not handled or not allowed
2026-01-10 18:26:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-black-cable-tie>: HTTP status code is not handled or not allowed
2026-01-10 18:26:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20-x-2-1-4-machine-screw-pan-head-phillips-18-8-stainless-steel-ft-unc-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:26:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-anti-static-bags-13w-x-18l-4-mil-pink-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 18:26:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20-x-2-1-2-machine-screw-round-head-phillips-slotted-steel-zinc-ft-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:26:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010180-caster-3-in-swivelw-brake>: HTTP status code is not handled or not allowed
2026-01-10 18:26:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-classicseries-part-mount-seat-tiss-dispens-dispos-through-part>: HTTP status code is not handled or not allowed
2026-01-10 18:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/bollards/safety_bollards_posts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:26:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-conturaseries-surface-mounted-soap-dispenser>: HTTP status code is not handled or not allowed
2026-01-10 18:26:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/synthetic-winch-line-with-stainless-steel-thimble-38-dia-x-50l>: HTTP status code is not handled or not allowed
2026-01-10 18:26:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keyboard-tray-for-series-carts>: HTTP status code is not handled or not allowed
2026-01-10 18:26:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelate-wire-shelf-truck-36x18x69-1200-pound-capacity-with-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:26:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-18-x-72-phenolic-locker-double-tier-graphite-grafix>: HTTP status code is not handled or not allowed
2026-01-10 18:26:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/317466-16-combo-push-broom-soft-stiff-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/overhead_clearance_bars_door_guards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:26:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-12-x-72-phenolic-locker-single-tier-silver-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:26:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5380-77-2-216-3-0-pipe-brush-medium-green>: HTTP status code is not handled or not allowed
2026-01-10 18:26:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/bollards/safety_bollards_posts>: HTTP status code is not handled or not allowed
2026-01-10 18:26:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-w-x-30-d-production-workbench-shop-top-safety-edge-complete-bench-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/wire_cable/network_data_cable already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:26:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/697277-3-stainless-steel-scraper-pink>: HTTP status code is not handled or not allowed
2026-01-10 18:26:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-w-x-36-d-production-workbench-phenolic-resin-safety-edge-complete-bench-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:26:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8345-containment-berm-track-belts-30-by-72-pvc-set-of-2>: HTTP status code is not handled or not allowed
2026-01-10 18:26:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-rated-access-door-walls-ceilings-18-x-18>: HTTP status code is not handled or not allowed
2026-01-10 18:26:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dinex-base-for-stsii-turbo-temp-induction-chargers-12-cs-latte-dx821031>: HTTP status code is not handled or not allowed
2026-01-10 18:26:35 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/overhead_clearance_bars_door_guards> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/overhead_clearance_bars_door_guards landed on page that is not a product page.
2026-01-10 18:26:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-hand-truck-loop-handle-semi-pneumatic-wheels>: HTTP status code is not handled or not allowed
2026-01-10 18:26:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40112-4-stainless-steel-handle-mounted-scraper-green>: HTTP status code is not handled or not allowed
2026-01-10 18:26:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/77-wall-inlet-8l-x-4-38w-x-3h-white>: HTTP status code is not handled or not allowed
2026-01-10 18:26:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/wire_cable/network_data_cable>: HTTP status code is not handled or not allowed
2026-01-10 18:26:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/synthetic-winch-line-extension-with-ss-thimble-kevlar-tail-716-dia-x-75l>: HTTP status code is not handled or not allowed
2026-01-10 18:26:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35874-medium-hand-brush-medium-red>: HTTP status code is not handled or not allowed
2026-01-10 18:26:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dinex-fenwick-insulated-dome-10-d-12-cs-onyx-dx540003>: HTTP status code is not handled or not allowed
2026-01-10 18:26:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-snow-ice-melting-heated-walkway-mat-3-x-20-120-volts>: HTTP status code is not handled or not allowed
2026-01-10 18:26:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1211162-glide-table-shox-1-4-20>: HTTP status code is not handled or not allowed
2026-01-10 18:26:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fir-plywood-premium-grade-crate-premium28-22-11-collapsible-inside-28l-x-22w-x-11>: HTTP status code is not handled or not allowed
2026-01-10 18:26:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-120x48x96-add-on-unit-green-orange-6700-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:26:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pxcmlc1683066-16rhp-single-stage-piston-comp30-gal-vert135-psi-1-phase-120-240v>: HTTP status code is not handled or not allowed
2026-01-10 18:26:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fiberwood-dolly-36-l-x-18-w-700-lb-cap-3-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:26:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-height-steel-floor-lock-8-10-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:26:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-mesh-security-cage-48x24x60>: HTTP status code is not handled or not allowed
2026-01-10 18:26:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-coated-cast-iron-dumbbell-set-with-floor-rack-20-piece-set>: HTTP status code is not handled or not allowed
2026-01-10 18:26:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40124-nylon-scraper-with-threaded-handle-red>: HTTP status code is not handled or not allowed
2026-01-10 18:26:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wireway-husky-tear-drop-pallet-rack-add-on-96x36x96>: HTTP status code is not handled or not allowed
2026-01-10 18:26:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exercise-weight-bar-7-5-lb-black-stripe>: HTTP status code is not handled or not allowed
2026-01-10 18:26:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-plastic-folding-chair-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:27:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-ss-nsf-wall-shelf-single-bar-pot-rack-29>: HTTP status code is not handled or not allowed
2026-01-10 18:27:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/261549-male-branch-tee>: HTTP status code is not handled or not allowed
2026-01-10 18:27:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-door-wall-mountable-film-box-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:27:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/economy-ss-nsf-wall-shelf-17>: HTTP status code is not handled or not allowed
2026-01-10 18:27:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triple-handle-chest-floor-overhead-weight-pulley-system-with-dual-weight-stack-10-x-2-2-lb-weights>: HTTP status code is not handled or not allowed
2026-01-10 18:27:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/350-10-3ble-dual-ramp-wheelchair-scale-with-handrail-bluetooth-ble-4-0-1000-lb-x-0-2-lb>: HTTP status code is not handled or not allowed
2026-01-10 18:27:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stretch-unlined-bib-overall-m-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:27:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-splice-for-15-tubing-polished-brass>: HTTP status code is not handled or not allowed
2026-01-10 18:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/cookware_bakeware/pots_pans/saute_pots_pans already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:27:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8190 pages (at 95 pages/min), scraped 3452 items (at 43 items/min)
2026-01-10 18:27:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/americana-climbing-wind-safety-helmet-type-2-4-point-mega-ratchet-suspension-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:27:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/80-quart-heavy-duty-stock-pot>: HTTP status code is not handled or not allowed
2026-01-10 18:27:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ice-dispenser-floor-model-approx-120-pound-ice-storage-capacity-floor-model>: HTTP status code is not handled or not allowed
2026-01-10 18:27:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-tube-1-x-050-x-4-satin-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:27:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-a325-ph-conductivity-meter-kit-stara3255>: HTTP status code is not handled or not allowed
2026-01-10 18:27:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-eye-adjustable-manual-trolley-2000lb>: HTTP status code is not handled or not allowed
2026-01-10 18:27:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-cube-ice-maker-approx-336-lb-production-full-size-cube>: HTTP status code is not handled or not allowed
2026-01-10 18:27:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/74-h-nexel-chrome-wire-shelving-add-on-60-w-x-30-d>: HTTP status code is not handled or not allowed
2026-01-10 18:27:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/foodservice/cookware_bakeware/pots_pans/saute_pots_pans>: HTTP status code is not handled or not allowed
2026-01-10 18:27:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/molded-dual-handle-medicine-ball-22-lb-10-kg-gold>: HTTP status code is not handled or not allowed
2026-01-10 18:27:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/molded-dual-handle-medicine-ball-11-lb-5-kg-red>: HTTP status code is not handled or not allowed
2026-01-10 18:27:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precharged-tubing-kit-75-ft-for-units-using-r-404a-refrigerant-75-ft>: HTTP status code is not handled or not allowed
2026-01-10 18:27:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/soft-pliable-medicine-ball-11-lb-7-diameter-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:27:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-spatula-13-5-inch-nsf>: HTTP status code is not handled or not allowed
2026-01-10 18:27:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-oxford-insulated-safety-bib-overall-l-black>: HTTP status code is not handled or not allowed
2026-01-10 18:27:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fuse-holder-lockout-plastic-red>: HTTP status code is not handled or not allowed
2026-01-10 18:27:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-oz-1-piece-nsf-heavy-duty-ladle>: HTTP status code is not handled or not allowed
2026-01-10 18:27:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/relaxed-fit-twill-safety-cargo-utility-pants-34l-inseam-x-34-waist-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:27:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-cutting-board-1>: HTTP status code is not handled or not allowed
2026-01-10 18:27:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-end-dome-with-drop-cord-and-2-speed-for-642-motor-only>: HTTP status code is not handled or not allowed
2026-01-10 18:27:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-pan-3-false-bottom>: HTTP status code is not handled or not allowed
2026-01-10 18:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/anchors_hangers/wedge_anchors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:27:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/servewell-2-well-hot-food-table-3>: HTTP status code is not handled or not allowed
2026-01-10 18:27:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-variable-length-plastic-9-seal-white-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:27:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/Hot-Surface-Furnace-Ignitor-Five-And-One-Quarter-Inch-Lead-Wire-Length>: HTTP status code is not handled or not allowed
2026-01-10 18:27:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-adjustable-one-piece-seal-black-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:27:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-3664-waste-drain-overflow-elbow-1-1-4-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:27:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kennedy-10-drawer-mechanic-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:27:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pop-blind-rivet-1-8-x-4-3-countersunk-head-up-to-3-16-grip-aluminum-steel-pkg-of-500>: HTTP status code is not handled or not allowed
2026-01-10 18:27:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-metal-cable-seal-1-16-wx12-l-green-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:27:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-colored-file-folders-13-cut-one-ply-tab-letter-green-100box>: HTTP status code is not handled or not allowed
2026-01-10 18:27:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-metal-cable-seal-1-16-wx24-l-green-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:27:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/690197-jtm-4vs-1-milling-machine-w-x-y-axis-powerfeeds-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 18:27:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/fasteners/anchors_hangers/wedge_anchors>: HTTP status code is not handled or not allowed
2026-01-10 18:27:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pop-monobolt-blind-rivet-1-4-dome-head-350-625-grip-range-aluminum-aluminum-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:27:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rod-clevis-with-pin-cs-20-for-iso-cylinders-m8x1-25-threads>: HTTP status code is not handled or not allowed
2026-01-10 18:27:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/54-h-nexel-chrome-wire-shelving-add-on-48-w-x-36-d>: HTTP status code is not handled or not allowed
2026-01-10 18:27:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/63-h-nexel-chrome-wire-shelving-24-w-x-14-d>: HTTP status code is not handled or not allowed
2026-01-10 18:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/crowd_control/crowd_control_barricades already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:27:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bottlejacks-jet-453317>: HTTP status code is not handled or not allowed
2026-01-10 18:27:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamps-wilton14128>: HTTP status code is not handled or not allowed
2026-01-10 18:27:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-insulated-hydro-parka-jacket-m-black>: HTTP status code is not handled or not allowed
2026-01-10 18:27:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bottlejacks-jet-453323k>: HTTP status code is not handled or not allowed
2026-01-10 18:27:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viseaccessories-wilton14842>: HTTP status code is not handled or not allowed
2026-01-10 18:27:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16h-steps-stages>: HTTP status code is not handled or not allowed
2026-01-10 18:27:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fireproof-4-drawer-vertical-file-cabinet-legal-letter-25-1-16-lx17-3-4-wx52-3-4-h-parchment>: HTTP status code is not handled or not allowed
2026-01-10 18:27:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rivetinghammers-jet-jsg-0101r>: HTTP status code is not handled or not allowed
2026-01-10 18:27:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-ripstop-fleece-lined-safety-jacket-4xl-fluorescent-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:27:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/crowd_control/crowd_control_barricades> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/crowd_control/crowd_control_barricades landed on page that is not a product page.
2026-01-10 18:27:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamps-wilton14798>: HTTP status code is not handled or not allowed
2026-01-10 18:28:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cpr-mask-with-02-inlet-10-502>: HTTP status code is not handled or not allowed
2026-01-10 18:28:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bandsaws-jet-708754b>: HTTP status code is not handled or not allowed
2026-01-10 18:28:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011472-disconect-3-8-inch-male-female>: HTTP status code is not handled or not allowed
2026-01-10 18:28:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2481011-knob-carriage-arm-for-univex>: HTTP status code is not handled or not allowed
2026-01-10 18:28:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fanny-pack-stuffed-with-cpr-maskbandagesgauze-red-10-103-red-s1>: HTTP status code is not handled or not allowed
2026-01-10 18:28:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8ft-long-shirred-pleat-skirting-16h-stage-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:28:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-13-cut-assorted-position-file-folders-one-ply-top-tab-legal-manila-100box>: HTTP status code is not handled or not allowed
2026-01-10 18:28:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-supertab-pocket-redrope-5-14-accordion-expansion-letter-10box>: HTTP status code is not handled or not allowed
2026-01-10 18:28:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8287 pages (at 97 pages/min), scraped 3493 items (at 41 items/min)
2026-01-10 18:28:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamps-hargrave-20485>: HTTP status code is not handled or not allowed
2026-01-10 18:28:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carbon-fiber-felt-welding-blanket-6w-x-6h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:28:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8ft-long-shirred-pleat-skirting-24h-stage-black>: HTTP status code is not handled or not allowed
2026-01-10 18:28:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-100mm-bore-x-150mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:28:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-100mm-bore-x-620mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:28:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-63mm-bore-x-20mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:28:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-63mm-bore-x-280mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:28:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stage-pie-unit-carpet-48w-x-16h-stage-units-red>: HTTP status code is not handled or not allowed
2026-01-10 18:28:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-wire-shelf-60x18>: HTTP status code is not handled or not allowed
2026-01-10 18:28:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-ripstop-4-in-1-safety-jacket-2xl-fluorescent-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:28:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-r-class-2-two-tone-surveyor-safety-vest-5xl-green-sv6g5x>: HTTP status code is not handled or not allowed
2026-01-10 18:28:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-desiccant-dehumidifier-dd900-460v-10-amps-7-6-kw-364-pints>: HTTP status code is not handled or not allowed
2026-01-10 18:28:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-100mm-bore-x-100mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:28:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fr-type-r-class-2-economy-mesh-vest-4xl-green-sv97e-2vgm-4x>: HTTP status code is not handled or not allowed
2026-01-10 18:28:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/klever-kutter-box-cutter-red>: HTTP status code is not handled or not allowed
2026-01-10 18:28:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-80mm-bore-x-370mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:28:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-63mm-bore-x-440mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:28:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/compress-tri-sectional-8-x-16>: HTTP status code is not handled or not allowed
2026-01-10 18:28:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cold-pain-relief-gel-4-oz-tube-11-1031-1>: HTTP status code is not handled or not allowed
2026-01-10 18:28:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-edge-work-bench-top-12-gauge-steel-1>: HTTP status code is not handled or not allowed
2026-01-10 18:28:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-male-50000n-6-38-6mm-tube-x-38-swift-fit-univ-thread>: HTTP status code is not handled or not allowed
2026-01-10 18:28:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-r-class-2-two-tone-surveyor-safety-vest-3xl-orange-sv6o3x>: HTTP status code is not handled or not allowed
2026-01-10 18:28:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-32mm-bore-x-1270mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:28:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kolorcut-cutting-board-12x18x1-2-green>: HTTP status code is not handled or not allowed
2026-01-10 18:28:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bib-apron-25x28-naugahyde-leather-look-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:28:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-expandable-add-on-rack-72x24x84-gray-with-3-level-wood-deck-750lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 18:28:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reusable-hot-and-cold-compress-5-x-10-case-of-24>: HTTP status code is not handled or not allowed
2026-01-10 18:28:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-additional-level-wide-span-rack-96w-x-36d-no-deck-1100-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:28:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1591066-brush-toilet-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:28:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-poly-oxford-lined-safety-parka-jacket-xl-fluorescent-green>: HTTP status code is not handled or not allowed
2026-01-10 18:28:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-1-4-flexi-spring-end>: HTTP status code is not handled or not allowed
2026-01-10 18:28:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/needle-valve-55925-6-m5-knob-adj-6mm-tube-x-m5-thread-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 18:28:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-flexi-closet-auger>: HTTP status code is not handled or not allowed
2026-01-10 18:28:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-record-storage-rack-gray-96-wx-48-d-x-60-h-with-polyethylene-file-boxes>: HTTP status code is not handled or not allowed
2026-01-10 18:28:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-40mm-bore-x-320mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 18:28:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-4-drain-flush-bag>: HTTP status code is not handled or not allowed
2026-01-10 18:28:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-wide-span-rack-96x24x84-gray-with-3-shelves-laminated-deck-1100-lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 18:28:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-wire-shelving-add-on-24-w-x-18-d-x-74-h>: HTTP status code is not handled or not allowed
2026-01-10 18:28:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-polypropylene-seal-top-bag-with-hang-hole-5-x-3-2-mil>: HTTP status code is not handled or not allowed
2026-01-10 18:28:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/saddle-pack-printed-portion-control-bags-tuesday-print-in-yellow-ink-7-x-65-05-mil>: HTTP status code is not handled or not allowed
2026-01-10 18:29:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-black-urethane-reusable-cold-pack-circular-10-diameter-12-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:29:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-run-tee-55222-8-14-8mm-tube-x-14-swift-fit-univ-thread-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 18:29:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vollrath-winged-corkscrew-cap-lifter>: HTTP status code is not handled or not allowed
2026-01-10 18:29:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pain-relief-roll-on-3-oz-bottle-case-of-12>: HTTP status code is not handled or not allowed
2026-01-10 18:29:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-36-w-x-18-d-x-74-h>: HTTP status code is not handled or not allowed
2026-01-10 18:29:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-piece-plastic-color-coded-shim-assortment-10-inch-x-20-inch-flat-sheets>: HTTP status code is not handled or not allowed
2026-01-10 18:29:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-extra-shelving-48x18x96-with-5-shelves-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:29:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0625-inch-id-x-0874-inch-od-x-0005-inch-die-button-shim-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 18:29:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8380 pages (at 93 pages/min), scraped 3538 items (at 45 items/min)
2026-01-10 18:29:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-wide-span-rack-96x36x96-gray-with-3-shelves-laminated-deck-1100-lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 18:29:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-heavy-duty-shelving-48x18x60-with-4-shelves-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:29:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009425-heating-element-120v-1700w-for-carter-hoffmann>: HTTP status code is not handled or not allowed
2026-01-10 18:29:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-strip-10-outlets-4>: HTTP status code is not handled or not allowed
2026-01-10 18:29:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-heavy-duty-shelving-48x18x72-with-4-shelves-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:29:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-raise-n-roll-machinery-dolly-10000-lb-capacity-pair>: HTTP status code is not handled or not allowed
2026-01-10 18:29:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264040-tube-overflow>: HTTP status code is not handled or not allowed
2026-01-10 18:29:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-12-inch-square-keystock-plain-finish-12-inch-length>: HTTP status code is not handled or not allowed
2026-01-10 18:29:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/00370-1-2-d-bolt-forged-anchor-130-420-lbs-capacity-galvanized-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:29:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-branch-tee-60210-04-04-14-tube-x-14-swift-fit-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:29:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-elbow-55110-12-14-12mm-tube-x-14-swift-fit-univ-thread-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 18:29:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-elbow-55110-8-38-8mm-tube-x-38-swift-fit-univ-thread-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 18:29:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-extra-hd-boltless-shelving-add-on-36-in-w-x-18-in-d-x-72-in-h-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:29:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-bulk-rack-shelf-wire-deck-72x36-gray-1>: HTTP status code is not handled or not allowed
2026-01-10 18:29:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-36-in-w-x-18-in-d-x-72-in-h-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:29:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelf-36x24-with-4-clips-1>: HTTP status code is not handled or not allowed
2026-01-10 18:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/power_tools/power_sanders/abrasive_tool_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:29:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/little-giant-vcmx-series-condensate-removal-pump-safety-switch-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:29:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-branch-tee-60215-10-14-10mm-tube-x-14-male-bspp-thread-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:29:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-20-ga-48-wx30-dx73-h-open-clip-style-6-shelf>: HTTP status code is not handled or not allowed
2026-01-10 18:29:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pockets-metal-base-green>: HTTP status code is not handled or not allowed
2026-01-10 18:29:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thru-wall-package-drop-wth-tilt-out-door-dvwm0062s-sand>: HTTP status code is not handled or not allowed
2026-01-10 18:29:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/34-1069-warmer-element-208v-1000w-18-inch-x-8-1-2-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:29:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-piece-metric-steel-shim-stock-assortment-150mm-x-300mm-sheets>: HTTP status code is not handled or not allowed
2026-01-10 18:29:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/00015-inch-brass-shim-stock-6-inch-x-60-inch-roll>: HTTP status code is not handled or not allowed
2026-01-10 18:29:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aro-plug-80272-04-14-x-14-female-nptf>: HTTP status code is not handled or not allowed
2026-01-10 18:29:40 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/power_tools/power_sanders/abrasive_tool_accessories> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/power_tools/power_sanders/abrasive_tool_accessories landed on page that is not a product page.
2026-01-10 18:29:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/140-mig-welder-30-140a-120v-14>: HTTP status code is not handled or not allowed
2026-01-10 18:29:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-mount-above-ground-post-for-weekend-away-mail-protector-dvjr0060-dvcs0070-dvjr0060pa-bk>: HTTP status code is not handled or not allowed
2026-01-10 18:29:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/51054-100-heavy-duty-plastic-barrier-chain-hdpe-2-x100-54mm-green>: HTTP status code is not handled or not allowed
2026-01-10 18:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/flashlights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:29:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/weekend-away-secure-mailbox-with-vault-dvjr0060-front-access-copper-vein>: HTTP status code is not handled or not allowed
2026-01-10 18:29:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50004-100-plastic-barrier-chain-hdpe-2-x100-8-51mm-green>: HTTP status code is not handled or not allowed
2026-01-10 18:29:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36x24x74-stainless-steel-solid-shelving>: HTTP status code is not handled or not allowed
2026-01-10 18:29:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30037-100-plastic-barrier-chain-hdpe-alternating-colors-1-5-x100-6-38mm-red-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:29:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd12h-916-inch-band-heavy-duty-3-pc-part-ss-hose-clamp-10-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:29:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50154-plastic-barrier-chain-on-a-reel-hdpe-2-x125-8-51mm-green>: HTTP status code is not handled or not allowed
2026-01-10 18:29:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/261874-kason-10065009072-pilaster-72-for-kason>: HTTP status code is not handled or not allowed
2026-01-10 18:29:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m5-x-0-8-x-16mm-phillips-oval-head-machine-screw-304-stainless-steel-din-966-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:29:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-branch-tee-55210-10-12-10mm-tube-x-12-swift-fit-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 18:29:53 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/flashlights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/flashlights landed on page that is not a product page.
2026-01-10 18:29:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1271161-door-gasket-1850-x-2125>: HTTP status code is not handled or not allowed
2026-01-10 18:29:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smartcompliance-plastic-bandage-38-x-1-12-80box>: HTTP status code is not handled or not allowed
2026-01-10 18:29:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-dividable-8>: HTTP status code is not handled or not allowed
2026-01-10 18:29:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd40sn-916-inch-band-heavy-duty-4-pc-hose-clamp-2-18-inch-2-1516-inch-clmpgdiam-10-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:29:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m4-x-0-7-x-8mm-machine-screw-phillips-flat-head-304-stainless-steel-din-965-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:29:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-x-36-2-door-outdoor-enclosed-corkboard-satin-aluminum-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:30:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30325-10-s-hook-acetal-copolymer-1-5-safety-pink-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 18:30:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b40h-part-ss-worm-gear-hose-clamp-2-116-inch-3-inch-clamping-diameter-box-of-10>: HTTP status code is not handled or not allowed
2026-01-10 18:30:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-locker-double-tier-12x15x36-6-door-parchment>: HTTP status code is not handled or not allowed
2026-01-10 18:30:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-hi-vis-t-shirt-3xl-regular-fluorescent-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:30:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-work-shirt-3xl-short-tan>: HTTP status code is not handled or not allowed
2026-01-10 18:30:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1191102-leg-4-inch-h-stainless-steel-5-8-11>: HTTP status code is not handled or not allowed
2026-01-10 18:30:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cs28h-collared-screw-worm-gear-hose-clamp-1-516-inch-2-14-inch-clamping-diam-10-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:30:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-quart-pail-galvanized-steel-for-freestanding-ashtray>: HTTP status code is not handled or not allowed
2026-01-10 18:30:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8477 pages (at 97 pages/min), scraped 3582 items (at 44 items/min)
2026-01-10 18:30:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-48-tenv-1ph-3450rpm-c4c34nb2ee>: HTTP status code is not handled or not allowed
2026-01-10 18:30:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-basket-10-9-16-l-x-8-7-16-w-x-6-1-4-h-stainless-steel-price-each-for-qty-4>: HTTP status code is not handled or not allowed
2026-01-10 18:30:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/recycle-42-square-container-dome-lid-black>: HTTP status code is not handled or not allowed
2026-01-10 18:30:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b12hs-all-ss-worm-gear-hose-clamp-916-inch-1-14-inch-clamping-diameter-box-of-10>: HTTP status code is not handled or not allowed
2026-01-10 18:30:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comfy-finger-separator-pediatric-small>: HTTP status code is not handled or not allowed
2026-01-10 18:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/single_phase_motors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:30:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-mesh-basket-3-3-16-dia-x-12-h-stainless-steel-price-each-for-qty-4>: HTTP status code is not handled or not allowed
2026-01-10 18:30:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-work-shirt-m-short-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:30:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/warning-line-system-galvanized-steel-4-stanchions-and-100-pennants>: HTTP status code is not handled or not allowed
2026-01-10 18:30:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-56-tefc-1ph-1725rpm-c6k17fc2ll>: HTTP status code is not handled or not allowed
2026-01-10 18:30:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dart-conex-translucent-plastic-cold-cups-7-oz>: HTTP status code is not handled or not allowed
2026-01-10 18:30:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-vinyl-medical-stool-beige>: HTTP status code is not handled or not allowed
2026-01-10 18:30:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s9833-5w-a19-led-220-bean-spread-medium-base-4000k>: HTTP status code is not handled or not allowed
2026-01-10 18:30:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sets-irwin-vise-grip-2078705>: HTTP status code is not handled or not allowed
2026-01-10 18:30:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-plastic-box-truck-14-bushel-medium-duty>: HTTP status code is not handled or not allowed
2026-01-10 18:30:27 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/single_phase_motors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/single_phase_motors landed on page that is not a product page.
2026-01-10 18:30:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-bookcase-four-shelf-34-1-2-w-x-12-5-8-d-x-59-h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:30:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-bookcase-two-shelf-34-1-2-w-x-12-5-8-d-x-29-h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:30:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-dh-air153-work-shirt-4xl-short-khaki>: HTTP status code is not handled or not allowed
2026-01-10 18:30:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-dh-air153-work-shirt-5xl-tall-khaki>: HTTP status code is not handled or not allowed
2026-01-10 18:30:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-magnetic-floor-sweeper-36-w>: HTTP status code is not handled or not allowed
2026-01-10 18:30:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-plastic-box-truck-16-bushel>: HTTP status code is not handled or not allowed
2026-01-10 18:30:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/851263-bag-filter-oil-polishing-for-miroil>: HTTP status code is not handled or not allowed
2026-01-10 18:30:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011697-hinge-kit-left-for-perlick-refrigeration>: HTTP status code is not handled or not allowed
2026-01-10 18:30:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-forge-and-foundry-eight-inch-bench-grinder>: HTTP status code is not handled or not allowed
2026-01-10 18:30:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-zip-front-hoodie-xs-tall-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:30:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-vci-paper-30-global-30g-24-x-200-yds-2-rolls>: HTTP status code is not handled or not allowed
2026-01-10 18:30:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/line-voltage-programmable-thermostat-k302pe-double-pole-heat-only-120-208-240v-15a>: HTTP status code is not handled or not allowed
2026-01-10 18:30:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotom-189b-189-227-mfd-125-volts-start-round>: HTTP status code is not handled or not allowed
2026-01-10 18:30:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acrylic-eyewear-display-2-tier>: HTTP status code is not handled or not allowed
2026-01-10 18:30:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotom-45-5dvr-45-5-mfd-370-440-volts-run-round>: HTTP status code is not handled or not allowed
2026-01-10 18:30:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-gantry-crane-adjustable-height-8000-lb-capacity-3>: HTTP status code is not handled or not allowed
2026-01-10 18:30:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0125-inch-diameter-stainless-steel-wire-1-pound-coil>: HTTP status code is not handled or not allowed
2026-01-10 18:30:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-baked-epoxy-steel-step-on-can-16-quart>: HTTP status code is not handled or not allowed
2026-01-10 18:30:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-zip-front-hoodie-l-tall-navy>: HTTP status code is not handled or not allowed
2026-01-10 18:30:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/750va-low-profile-12-outlet>: HTTP status code is not handled or not allowed
2026-01-10 18:30:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1501511-dispenser-water-cup-stainless-steel-med-for-san-jamar>: HTTP status code is not handled or not allowed
2026-01-10 18:30:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-tube-for-20-ton-capacity-jack-stand>: HTTP status code is not handled or not allowed
2026-01-10 18:30:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inflationdeflation-kit-for-otr-tire-service>: HTTP status code is not handled or not allowed
2026-01-10 18:30:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dura-flate-handheld-digital-tire-inflator-25-to-200-psi-1-58l-hose>: HTTP status code is not handled or not allowed
2026-01-10 18:30:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twin-cluster-medium-base-socket>: HTTP status code is not handled or not allowed
2026-01-10 18:30:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vacuum-hose-18-gallon-wet-dry-squeegee-vacuum>: HTTP status code is not handled or not allowed
2026-01-10 18:30:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uno-ring-white>: HTTP status code is not handled or not allowed
2026-01-10 18:30:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/candelabra-base-phenolic-socket-with-pin-socket-pressure-fit>: HTTP status code is not handled or not allowed
2026-01-10 18:30:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/decoil-stretch-twinleg-lanyard-6l-snaphooks-w-rebar-hook>: HTTP status code is not handled or not allowed
2026-01-10 18:30:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hub-bro-replacement-strip-disc>: HTTP status code is not handled or not allowed
2026-01-10 18:30:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010128-caster-swivel-no-brake4-inch-dia-x1-1-2-1-2-x-1-th>: HTTP status code is not handled or not allowed
2026-01-10 18:30:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fork-blade-protectors-for-36-forks-polyethylene-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:31:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lab-pack-open-head-poly-drum-plastic-lever-lock-20-gallon-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 18:31:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gray-outdoor-ashtray>: HTTP status code is not handled or not allowed
2026-01-10 18:31:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mirage-cadet-induction-range-59310-canada-only-12-amps>: HTTP status code is not handled or not allowed
2026-01-10 18:31:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lab-pack-open-head-poly-drum-metal-lever-lock-55-gallon-capacity-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:31:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-panel-display-tower-6-ft-5-inch-high-fabric-summer-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:31:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/06095-1-16-x-3-x-4-plastic-horseshoe-shim-56-500pc>: HTTP status code is not handled or not allowed
2026-01-10 18:31:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keyless-unglazed-porcelain-socket-w-snap-in-clip>: HTTP status code is not handled or not allowed
2026-01-10 18:31:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sign-receptacle-2pc-unglazed-porcelain-medium-base-w-screw-terminals>: HTTP status code is not handled or not allowed
2026-01-10 18:31:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mirage-cadet-induction-range-59300-us-only-15-amps>: HTTP status code is not handled or not allowed
2026-01-10 18:31:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/open-shelf-file-cabinet-credenza-walnut-29-1-2-22-23-1-9>: HTTP status code is not handled or not allowed
2026-01-10 18:31:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-square-canteen-table-with-2-seats-surface-mount-red>: HTTP status code is not handled or not allowed
2026-01-10 18:31:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-w-x-12-d-plastic-laminate-cantilever-shelf>: HTTP status code is not handled or not allowed
2026-01-10 18:31:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8574 pages (at 97 pages/min), scraped 3620 items (at 38 items/min)
2026-01-10 18:31:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-step-24-steel-safety-angle-orange-rolling-ladder-serrated-sw1232g-o>: HTTP status code is not handled or not allowed
2026-01-10 18:31:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-tube-fitting-nylon-plastic-tee-adapter-532-tube-od-x-14-npt-female>: HTTP status code is not handled or not allowed
2026-01-10 18:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/seating/stools/bar_counter_height_stools/bar_stools already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:31:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-tube-fitting-nylon-plastic-straight-adapter-12-tube-od-x-12-npt-male>: HTTP status code is not handled or not allowed
2026-01-10 18:31:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-panel-divider-8-ft-high-x-5-ft-9-inch-long-fabric-black>: HTTP status code is not handled or not allowed
2026-01-10 18:31:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wear-ever-ever-smooth-fry-pan-e4012-8-gauge-9-3-4-bottom-diameter>: HTTP status code is not handled or not allowed
2026-01-10 18:31:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-tube-fitting-nylon-plastic-straight-connector-10mm-tube-od>: HTTP status code is not handled or not allowed
2026-01-10 18:31:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-tube-fitting-nylon-plastic-straight-adapter-8mm-tube-od-x-14-npt-male>: HTTP status code is not handled or not allowed
2026-01-10 18:31:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-flat-washer-sae-9-32-i-d-steel-plain-grade-2-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:31:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-external-tooth-lock-washer-109-102-i-d-016-01-thick-steel-zinc-grade-2-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:31:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ribbed-surface-mat-2-foot-wide-black-with-yellow-borders>: HTTP status code is not handled or not allowed
2026-01-10 18:31:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/seating/stools/bar_counter_height_stools/bar_stools>: HTTP status code is not handled or not allowed
2026-01-10 18:31:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8402570-fan-motor-assembly-w-bracket-condenser-for-traulsen>: HTTP status code is not handled or not allowed
2026-01-10 18:31:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-plate-1-2-thick-mat-3x60-foot-black-yellow-border>: HTTP status code is not handled or not allowed
2026-01-10 18:31:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-countersunk-finishing-washer-22-236-i-d-012-02-thick-brass-plain-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 18:31:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100ml-serological-pipet-individually-wrapped-in-bags-sterile-50-case>: HTTP status code is not handled or not allowed
2026-01-10 18:31:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snap-on-deck-magliner-gemini-senior-hand-truck>: HTTP status code is not handled or not allowed
2026-01-10 18:31:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8014138-hood-filter-type6-stainless-steel-12x16>: HTTP status code is not handled or not allowed
2026-01-10 18:31:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glass-fiber-syringe-filter-1-1um-30mm-sterile-30-case>: HTTP status code is not handled or not allowed
2026-01-10 18:31:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washdown-motor-56-tefc-1ph-1725rpm-c6c17wk2pp>: HTTP status code is not handled or not allowed
2026-01-10 18:31:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-profile-floor-jack-steel-3-ton-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:31:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/250ml-graduated-beaker-polypropylene-non-sterile-50-case>: HTTP status code is not handled or not allowed
2026-01-10 18:31:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-split-lock-washer-49-64-i-d-13-64-thick-steel-galvanized-grade-2-pkg-of-50>: HTTP status code is not handled or not allowed
2026-01-10 18:31:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100ml-graduated-beaker-polypropylene-non-sterile-100-case>: HTTP status code is not handled or not allowed
2026-01-10 18:31:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-hp-thrd-shaft-motor-115-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:31:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/304-stainless-steel-unpolished-short-90-elbow-for-butt-weld-fittings-for-34-tubeod>: HTTP status code is not handled or not allowed
2026-01-10 18:31:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reinforced-high-pressure-clear-pvc-tubing-1id-x-1-14od-x-25-ft>: HTTP status code is not handled or not allowed
2026-01-10 18:31:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mixing-bowl-xmix0702-7-quart-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:31:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/casters-for-ladder-racks>: HTTP status code is not handled or not allowed
2026-01-10 18:31:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wear-ever-professional-standard-strength-loaf-pan-5435-anodized-5-x-10-x-4>: HTTP status code is not handled or not allowed
2026-01-10 18:31:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-round-table-with-4-imme-armless-chairs-navy-seatmaple-top>: HTTP status code is not handled or not allowed
2026-01-10 18:31:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-red-pin-heavy-duty-dock-boards-4>: HTTP status code is not handled or not allowed
2026-01-10 18:31:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-round-table-with-4-imme-armless-chairs-white-seatespresso-top>: HTTP status code is not handled or not allowed
2026-01-10 18:31:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cdn-loud-alarm-timer-abs-plastic>: HTTP status code is not handled or not allowed
2026-01-10 18:31:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fast-dry-traffic-striping-paint-5-gallon-white-10002069>: HTTP status code is not handled or not allowed
2026-01-10 18:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery/lathes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:31:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/servewell-sl-hot-food-table-38214-4-well-23-3-amp>: HTTP status code is not handled or not allowed
2026-01-10 18:31:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slotted-hook-hangers-24-pack-charcoal-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:31:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10nf35k-nylon-plastic-adjustable-lever-w-steel-components-m10-x-1-5-tapped-thread>: HTTP status code is not handled or not allowed
2026-01-10 18:31:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/somerville-gravy-sauce-urn-4635410-4-quart>: HTTP status code is not handled or not allowed
2026-01-10 18:31:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honda-aero-750cc-motorcycle-replacement-battery-2004-2008>: HTTP status code is not handled or not allowed
2026-01-10 18:31:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/321507-gh-1440zx-large-spindle-bore-lathe-w-acu-rite-200s-taper-attachment-collet-closer>: HTTP status code is not handled or not allowed
2026-01-10 18:31:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arkadia-16-quart-stock-pot-7304-6-gauge-12-depth>: HTTP status code is not handled or not allowed
2026-01-10 18:31:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-starter-rack-48x24x96-with-3-level-steel-deck-1500lb-cap-per-shelf-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:32:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/machining/machinery/lathes>: HTTP status code is not handled or not allowed
2026-01-10 18:32:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1571167-gas-hose-flex-ctd-1-x48-w-90-5-3-4-od-for-ts-brass-bronze-works>: HTTP status code is not handled or not allowed
2026-01-10 18:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=690036-jvm-836-1-vertical-milling-machine-1-1-2-hp-115v-1-phase already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:32:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-plate-ergonomic-mat-9-16-thick-36-wide-black-yellow-border-up-to-75>: HTTP status code is not handled or not allowed
2026-01-10 18:32:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-wall-insulated-serving-bowl-4659150-3-4-quart-pearl-white>: HTTP status code is not handled or not allowed
2026-01-10 18:32:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/690140-jtm-4vs-milling-machine-w-3-axis-acu-rite-200s-dro-quill-x-y-axis-powerfeeds>: HTTP status code is not handled or not allowed
2026-01-10 18:32:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ladder-for-model-242027-hand-operated-lift-truck>: HTTP status code is not handled or not allowed
2026-01-10 18:32:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acry-fab-flush-mount-stir-stick-holder-fms-5>: HTTP status code is not handled or not allowed
2026-01-10 18:32:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pre-built-roller-bearing-unit-28-1-2-w-x-20-1-2-d-x-32-h-4-steel-bins-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:32:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8668 pages (at 94 pages/min), scraped 3664 items (at 44 items/min)
2026-01-10 18:32:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cm-valuestar-electric-chain-hoist-with-chain-container-500-lb-capacity-1>: HTTP status code is not handled or not allowed
2026-01-10 18:32:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/checkerboard-design-high-back-mesh-chair-black>: HTTP status code is not handled or not allowed
2026-01-10 18:32:13 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=690036-jvm-836-1-vertical-milling-machine-1-1-2-hp-115v-1-phase> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=690036-jvm-836-1-vertical-milling-machine-1-1-2-hp-115v-1-phase landed on page that is not a product page.
2026-01-10 18:32:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-square-table-with-4-imme-armless-caster-chairs-light-gray-seatmaple-top>: HTTP status code is not handled or not allowed
2026-01-10 18:32:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-round-table-with-4-imme-armless-barstools-black-seatmaple-top>: HTTP status code is not handled or not allowed
2026-01-10 18:32:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-add-on-rack-96x36x96-with-3-levels-steel-deck-800lb-cap-per-level-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:32:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cm-lodestar-electric-chain-hoist-with-chain-container-500-lb-capacity-4>: HTTP status code is not handled or not allowed
2026-01-10 18:32:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-add-on-rack-48x48x96-with-3-levels-wire-deck-1500-lb-cap-per-level-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:32:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pedestal-stand-for-bench-grinders-11-inch-x-10-inch-mounting-surface>: HTTP status code is not handled or not allowed
2026-01-10 18:32:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/additional-level-48x48-high-capacity-rack-steel-deck-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:32:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-deck-narrow-aisle-high-end-platform-truck-60-l-x-24-w>: HTTP status code is not handled or not allowed
2026-01-10 18:32:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nickel-pull-switch-spst-6a-125-vac-o-f>: HTTP status code is not handled or not allowed
2026-01-10 18:32:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/additional-level-96x48-high-capacity-rack-steel-deck-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:32:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merit-66623340037-abrasotex-non-woven-quick-change-disc-2-inch-dia-med-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 18:32:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-durable-floor-tape-yellow-3-x-100-3-pack-wear-resistant-pvc>: HTTP status code is not handled or not allowed
2026-01-10 18:32:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010586-front-burner-kit-for-garland-range>: HTTP status code is not handled or not allowed
2026-01-10 18:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/lockers/standard_lockers/steel_standard_lockers/heavy_duty_steel_lockers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:32:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012957-blower-assembly-240v-390-690-for-henny-penny>: HTTP status code is not handled or not allowed
2026-01-10 18:32:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-inch-angle-grinder>: HTTP status code is not handled or not allowed
2026-01-10 18:32:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-4-shelf-retainer-divider>: HTTP status code is not handled or not allowed
2026-01-10 18:32:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/breeze-task-chair-with-headrest-high-back-19-22-12h-seat-black>: HTTP status code is not handled or not allowed
2026-01-10 18:32:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cayenne-sandwich-press-40790>: HTTP status code is not handled or not allowed
2026-01-10 18:32:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/175806-beater-60-qt-hob-legacy>: HTTP status code is not handled or not allowed
2026-01-10 18:32:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gearmotor-dc-parallel-42rpm-cm34d25nz75a>: HTTP status code is not handled or not allowed
2026-01-10 18:32:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-8-3-8-w-x-23-5-8-d-x-4-h-yellow-1>: HTTP status code is not handled or not allowed
2026-01-10 18:32:35 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/lockers/standard_lockers/steel_standard_lockers/heavy_duty_steel_lockers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/lockers/standard_lockers/steel_standard_lockers/heavy_duty_steel_lockers landed on page that is not a product page.
2026-01-10 18:32:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/redco-instacut-3-1-2-corer-dicer-wedger-15022-8-section-wedge-cut-wall-mount>: HTTP status code is not handled or not allowed
2026-01-10 18:32:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/291835-5-flag-room-id-system-4-l-aluminum-flags-1-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:32:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/891817-7-flag-room-id-system-8-l-aluminum-flags-1-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:32:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-square-table-with-4-imme-armless-barstools-black-seatespresso-top>: HTTP status code is not handled or not allowed
2026-01-10 18:32:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-display-cabinet-40844-refrigerated-60-x-21-x-32-1-2>: HTTP status code is not handled or not allowed
2026-01-10 18:32:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-buffet-station-with-wire-grill-4667575-black-21-x-16-x-7-1-2>: HTTP status code is not handled or not allowed
2026-01-10 18:32:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/production-straight-drill-2600>: HTTP status code is not handled or not allowed
2026-01-10 18:32:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-output-xc6-0-battery-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/appliances/refrigerators_freezers/refrigerators/refrigerated_merchandisers_display_cases already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:32:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264593-grease-filter-stainless-steel-20-x-20-x-2-for-giles>: HTTP status code is not handled or not allowed
2026-01-10 18:32:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rcs107-arctic-radwear-cooling-headband-red-paisley>: HTTP status code is not handled or not allowed
2026-01-10 18:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/traffic_parking_lot_safety/traffic_safety_cones already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:32:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rw32-3z1y-heavy-duty-rip-stop-waterproof-rain-jacket-hi-viz-lime-4xl>: HTTP status code is not handled or not allowed
2026-01-10 18:32:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/french-fry-rack-3681-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:32:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-sign-post-72-h>: HTTP status code is not handled or not allowed
2026-01-10 18:32:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-pcs-30-inch-auger-anchor>: HTTP status code is not handled or not allowed
2026-01-10 18:32:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-168ven-kwik-change-venturi-blow-gun-nozzle-tip>: HTTP status code is not handled or not allowed
2026-01-10 18:32:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/68-1211-pump-motor-assembly-115v>: HTTP status code is not handled or not allowed
2026-01-10 18:32:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-184-turbo-blow-gun-engine-cleaner-3-8-npt>: HTTP status code is not handled or not allowed
2026-01-10 18:32:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/foodservice/appliances/refrigerators_freezers/refrigerators/refrigerated_merchandisers_display_cases> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/foodservice/appliances/refrigerators_freezers/refrigerators/refrigerated_merchandisers_display_cases landed on page that is not a product page.
2026-01-10 18:32:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graphic-facility-signs-no-smoking-plastic-7x7>: HTTP status code is not handled or not allowed
2026-01-10 18:32:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/traffic_parking_lot_safety/traffic_safety_cones>: HTTP status code is not handled or not allowed
2026-01-10 18:32:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bb1279-full-mortise-5-knuckle-ball-bearing-standard-weight-hinge-45-x-45-1279b0045004526d0n01>: HTTP status code is not handled or not allowed
2026-01-10 18:32:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-use-indoor-outdoor-control-box-2-lights-2-sensors-brackets-15-cord>: HTTP status code is not handled or not allowed
2026-01-10 18:32:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/256s-manual-wall-stop-and-holder-us26d>: HTTP status code is not handled or not allowed
2026-01-10 18:33:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/341086-urn-heater-w-cut-out230-240v-5000w-11-inch-l-x>: HTTP status code is not handled or not allowed
2026-01-10 18:33:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/riv-nut-tool-300-14-20-head>: HTTP status code is not handled or not allowed
2026-01-10 18:33:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/al-stratus-plaque-diffuser-with-10-neck-black-str-pq-10bk>: HTTP status code is not handled or not allowed
2026-01-10 18:33:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcslargxve-gas-cylinder-shoulder-label>: HTTP status code is not handled or not allowed
2026-01-10 18:33:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/justrite-replacement-lid-55-gallon-cease-fire-steel-waste-receptacle>: HTTP status code is not handled or not allowed
2026-01-10 18:33:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ptp207wt-tough-mark-strip>: HTTP status code is not handled or not allowed
2026-01-10 18:33:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5100-grade-1-heavy-duty-surface-door-closer-par-adj-2-6-alm-hdhos>: HTTP status code is not handled or not allowed
2026-01-10 18:33:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buckhorn-distribution-container-with-hinged-lid-21-1-2x15-1-4x12-1-2>: HTTP status code is not handled or not allowed
2026-01-10 18:33:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-heat-resistant-40-to-300-degrees-31>: HTTP status code is not handled or not allowed
2026-01-10 18:33:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/802s-door-bottom-sweep-48-dba-brush>: HTTP status code is not handled or not allowed
2026-01-10 18:33:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coffer-23-3-4-x-23-3-4-pvc-lay-in-tile-in-matte-white-pl6101>: HTTP status code is not handled or not allowed
2026-01-10 18:33:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/framing-nails-fr113-238b-2-3-8-x-113-plastic-collated-coated-smooth-shank-2000-bx>: HTTP status code is not handled or not allowed
2026-01-10 18:33:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ignition-20-4-way-stretch-task-chair-gray-lumbar-support-17-21h-seat-basaltwhite>: HTTP status code is not handled or not allowed
2026-01-10 18:33:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8768 pages (at 100 pages/min), scraped 3703 items (at 39 items/min)
2026-01-10 18:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/task_desk_chairs/task_office_chairs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:33:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-heat-resistant-40-to-300-degrees-56>: HTTP status code is not handled or not allowed
2026-01-10 18:33:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-platter-cart-12-trays-10-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:33:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-syle-2-48-3-8-x-24-3-8-pvc-glue-up-tile-in-brushed-aluminum-pg5108>: HTTP status code is not handled or not allowed
2026-01-10 18:33:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1681547-element-208v-85kw-for-frymaster>: HTTP status code is not handled or not allowed
2026-01-10 18:33:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-single-socket-tee-3>: HTTP status code is not handled or not allowed
2026-01-10 18:33:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-aluminum-pan-cart-12-pans-18-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:33:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2241030-pusher-assembly-1-4-inch-easy-onion-for-nemco>: HTTP status code is not handled or not allowed
2026-01-10 18:33:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-syle-3-23-3-4-x-23-3-4-pvc-lay-in-tile-in-argent-sliver-pl5409>: HTTP status code is not handled or not allowed
2026-01-10 18:33:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-w-x-16-1-2-d-x-9-1-2-h-stackbox-black>: HTTP status code is not handled or not allowed
2026-01-10 18:33:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-x-72-table-with-6-imme-armless-chairs-navy-seatriver-cherry-top>: HTTP status code is not handled or not allowed
2026-01-10 18:33:20 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/task_desk_chairs/task_office_chairs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/task_desk_chairs/task_office_chairs landed on page that is not a product page.
2026-01-10 18:33:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-3254-5-inch-swivel-stem-caster-with-brake-for-7-8-inch-square-post-260-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:33:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-side-outlet-tee-4>: HTTP status code is not handled or not allowed
2026-01-10 18:33:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1571111-connector-gas-3-4-inch-x36-inch-for-dormont-mfg>: HTTP status code is not handled or not allowed
2026-01-10 18:33:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-10-w-x-24-d-x-8-h-stackbin-hopper-front-container>: HTTP status code is not handled or not allowed
2026-01-10 18:33:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40-open-display-merchandiser-white>: HTTP status code is not handled or not allowed
2026-01-10 18:33:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mini-no-touch-dual-vendor-free-white-battery-operated>: HTTP status code is not handled or not allowed
2026-01-10 18:33:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tar158-danger-barricade>: HTTP status code is not handled or not allowed
2026-01-10 18:33:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x1075-4-mil-poly-tubing>: HTTP status code is not handled or not allowed
2026-01-10 18:33:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blickman-howard-instrument-shelf-table-36l-x-24w-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 18:33:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-72in-w-x-48in-d-x-60in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:33:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-marker-booklet-0-9>: HTTP status code is not handled or not allowed
2026-01-10 18:33:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10195173-construction-harness-back-chest-hip-d-rings-tongue-buckle-leg-straps-std>: HTTP status code is not handled or not allowed
2026-01-10 18:33:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6x6x1-1-4-literature-mailers>: HTTP status code is not handled or not allowed
2026-01-10 18:33:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10193128-standard-single-leg-energy-absorbing-6-tie-back-lanyard-ansi-z359-13-2013>: HTTP status code is not handled or not allowed
2026-01-10 18:33:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/marble-sof-tyle-grande-mat-3-ft-x-custom-length-grey>: HTTP status code is not handled or not allowed
2026-01-10 18:33:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/marble-sof-tyle-grande-mat-4-ft-x-custom-length-black>: HTTP status code is not handled or not allowed
2026-01-10 18:33:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-extra-heavy-duty-boltless-shelving-starter-36in-w-x-24in-d-x-60in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:33:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-18-x-72-white-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:33:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10196702-harness-back-d-ring-tongue-buckle-leg-straps-extra-small>: HTTP status code is not handled or not allowed
2026-01-10 18:33:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-eye-rigging-hook-latch-kit-3000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:33:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011722-bin-thermostat-for-kold-draft-refrigeration>: HTTP status code is not handled or not allowed
2026-01-10 18:33:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/packard-foot-mount-120208-240va-output-20va>: HTTP status code is not handled or not allowed
2026-01-10 18:33:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ratchet-lever-hoist-3-4-ton-capacity-5-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:33:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/er70s-6-mild-steel-solid-mig-welding-wire-030-10-lbs-spool>: HTTP status code is not handled or not allowed
2026-01-10 18:33:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-wall-mount-shelf-with-one-lip>: HTTP status code is not handled or not allowed
2026-01-10 18:33:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-wall-mount-shelf-with-one-lip>: HTTP status code is not handled or not allowed
2026-01-10 18:33:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fivestar-3-gal-self-contained-carpet-extractor-85-psi-pump-107-inch-waterlift-401tr>: HTTP status code is not handled or not allowed
2026-01-10 18:33:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-xps-153-1-phillips-1-insert-bit-matte-nickel-5-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:33:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-ft-hose-assembly-with-quick-connects-for-heated-extractors-343ac>: HTTP status code is not handled or not allowed
2026-01-10 18:33:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inox-grinding-wheel-36-grit-type-27-9-dia-x-1-4-t-x-7-8-cntr-hole-dia-10-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:33:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24x24x24-500-ect-71-heavy-duty-double-wall-boxes>: HTTP status code is not handled or not allowed
2026-01-10 18:33:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dynamic-2-1-2-fluid-glycerine-filled-pressure-gage-panel-flange-600-psi>: HTTP status code is not handled or not allowed
2026-01-10 18:34:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-x2900-1-5-mil-poly-tubing>: HTTP status code is not handled or not allowed
2026-01-10 18:34:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-18-x-54-red-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/boards_easels/enclosed_bulletin_boards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:34:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kushion-walk-unslotted-black-3-8in-x-3ft-x-5ft>: HTTP status code is not handled or not allowed
2026-01-10 18:34:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locking-storage-cabinet-36-w-x-18-d-x-42-h-with-removable-bins-3>: HTTP status code is not handled or not allowed
2026-01-10 18:34:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4x3-clear-face-document-envelopes>: HTTP status code is not handled or not allowed
2026-01-10 18:34:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-1-2x10-safety-data-sheets-sds-envelopes>: HTTP status code is not handled or not allowed
2026-01-10 18:34:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-60in-w-x-48in-d-x-72in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:34:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-heavy-duty-boltless-shelving-add-on-60in-w-x-36in-d-x-72in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:34:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosure-kit-slide-door-14-x-36-x-16-white>: HTTP status code is not handled or not allowed
2026-01-10 18:34:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009330-bjwa-thermostat>: HTTP status code is not handled or not allowed
2026-01-10 18:34:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-supreme-v-6-x-100-green>: HTTP status code is not handled or not allowed
2026-01-10 18:34:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8862 pages (at 94 pages/min), scraped 3743 items (at 40 items/min)
2026-01-10 18:34:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-72in-w-x-15in-d-x-60in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:34:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-36-x-72-red-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:34:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosure-kit-slide-door-14-x-36-x-13-black>: HTTP status code is not handled or not allowed
2026-01-10 18:34:13 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/boards_easels/enclosed_bulletin_boards> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/boards_easels/enclosed_bulletin_boards landed on page that is not a product page.
2026-01-10 18:34:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-72in-w-x-30in-d-x-72in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:34:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3x3-3-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 18:34:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16x24-2-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 18:34:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-20-round-sign-notice-safety-equipment-must-be-worn-no-exceptions>: HTTP status code is not handled or not allowed
2026-01-10 18:34:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-30-octagone-sign-stop-watch-for-forklifts>: HTTP status code is not handled or not allowed
2026-01-10 18:34:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-pres-cntr-dbl-solenoid-vlv-pilot-spr-cntred-1-2-nptf-24v-dc-3w-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 18:34:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-72inw-x-30ind-x-96inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:34:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-24x12-arrow-sign-exit-this-way>: HTTP status code is not handled or not allowed
2026-01-10 18:34:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-supreme-v-2-x-100-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:34:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-12-round-sign-emergency-shower-and-eyewash>: HTTP status code is not handled or not allowed
2026-01-10 18:34:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosure-kit-slide-door-14-x-36-x-18-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:34:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-with-wood-decking-72x24x72-add-on>: HTTP status code is not handled or not allowed
2026-01-10 18:34:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-and-one-quarter-inch-fnpt-brass-check-valve-buna-n-rubber-poppet>: HTTP status code is not handled or not allowed
2026-01-10 18:34:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-force-blaster-motorcycle-dryer-4-0-hp>: HTTP status code is not handled or not allowed
2026-01-10 18:34:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-chemical-splash-protection-hood-h30gv001>: HTTP status code is not handled or not allowed
2026-01-10 18:34:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lakeside-economy-late-tray>: HTTP status code is not handled or not allowed
2026-01-10 18:34:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/881200-electronic-thermostat-for-johnson-controls>: HTTP status code is not handled or not allowed
2026-01-10 18:34:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-2-double-solenoid-valve-pilot-g-1-2-24v-dc-3w-coil-led-connection>: HTTP status code is not handled or not allowed
2026-01-10 18:34:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/262266-spring5-3-4-for-comstock-castle>: HTTP status code is not handled or not allowed
2026-01-10 18:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coveralls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:34:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/51130-pyrolon-crfr-disposable-coverall-4x-gray-hood-elastic-face-wrists-ankles>: HTTP status code is not handled or not allowed
2026-01-10 18:34:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-without-decking-72x36x72-starter>: HTTP status code is not handled or not allowed
2026-01-10 18:34:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-pres-cntr-dbl-solenoid-vlv-pilot-spr-cntred-1-2-nptf-220v-ac-5va-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 18:34:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-pres-cntr-dbl-solenoid-vlv-pilot-spr-cntred-1-8-nptf-110v-ac-5va-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 18:34:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mw-drawer-layout-32-compartments-3-h>: HTTP status code is not handled or not allowed
2026-01-10 18:34:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/st-drawer-layout-30-compartments-3-h>: HTTP status code is not handled or not allowed
2026-01-10 18:34:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-without-decking-96x24x120-add-on>: HTTP status code is not handled or not allowed
2026-01-10 18:34:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-long-sleeve-henley-2xl-gray-c541ngebsls2xl>: HTTP status code is not handled or not allowed
2026-01-10 18:34:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/helium-standard-sit-stand-workstation-single-monitor-mount-black>: HTTP status code is not handled or not allowed
2026-01-10 18:34:46 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coveralls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coveralls landed on page that is not a product page.
2026-01-10 18:34:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-1-4-npt-double-solenoid-valve-pilot-24v-dc-2w-coil-black-connection>: HTTP status code is not handled or not allowed
2026-01-10 18:34:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12v-magnetic-mount-amber-mini-strobe-light>: HTTP status code is not handled or not allowed
2026-01-10 18:34:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-48-vdc-low-profile-permanent-mount-dual-flash-strobe-light>: HTTP status code is not handled or not allowed
2026-01-10 18:34:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-cal-ultrasoft-arc-flash-coat-xl-navy-c04up03xll32>: HTTP status code is not handled or not allowed
2026-01-10 18:34:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12910-265-piece-e-clip-assortment-maintenance-kit>: HTTP status code is not handled or not allowed
2026-01-10 18:34:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-with-wire-decking-96x36x120-add-on>: HTTP status code is not handled or not allowed
2026-01-10 18:34:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protective-cover-parcvrj25000-for-jetstream-250>: HTTP status code is not handled or not allowed
2026-01-10 18:34:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-96inw-x-48ind-x-60inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:34:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/53306-7mm-x-8mm-stainless-steel-metric-keystock-1-meter-length>: HTTP status code is not handled or not allowed
2026-01-10 18:34:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f28100-1-master-kit-100-ft-3-outlets>: HTTP status code is not handled or not allowed
2026-01-10 18:34:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-72inw-x-30ind-x-72inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:34:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f2005-1-tee-fitting>: HTTP status code is not handled or not allowed
2026-01-10 18:35:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-1-8-x-9-1-4-x-2-kraft-literature-mailers>: HTTP status code is not handled or not allowed
2026-01-10 18:35:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drink-mat-14067-nhl-san-jose-sharks-3-1-4-x-24-x-1>: HTTP status code is not handled or not allowed
2026-01-10 18:35:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-1-4-npt-double-solenoid-valve-pilot-24v-dc-2w-coil-led-connection>: HTTP status code is not handled or not allowed
2026-01-10 18:35:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit4sc40m12-40-cal-compliance-arc-flash-kit-w-short-coat-bib-overall-m-sz-12>: HTTP status code is not handled or not allowed
2026-01-10 18:35:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-starter-72inw-x-24ind-x-96inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:35:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-open-single-solenoid-valve-ext-pilot-1-8-nptf-24v-ac-5va-coil-led-connection>: HTTP status code is not handled or not allowed
2026-01-10 18:35:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pebble-surface-mat-black-48-es-wide>: HTTP status code is not handled or not allowed
2026-01-10 18:35:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-60inw-x-36ind-x-60inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:35:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 8957 pages (at 95 pages/min), scraped 3785 items (at 42 items/min)
2026-01-10 18:35:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-heavy-duty-boltless-shelving-add-on-60inw-x-36ind-x-72inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:35:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv08-lg10-8-cal-cm2-arc-flash-kit-with-fr-coverall-lg-glove-size-10>: HTTP status code is not handled or not allowed
2026-01-10 18:35:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit4sc100-lg09-100-cal-cm2-arc-flash-kit-lg-glove-size-09>: HTTP status code is not handled or not allowed
2026-01-10 18:35:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m18andno8482-cordless-2-tool-combo-kit-2691-22>: HTTP status code is not handled or not allowed
2026-01-10 18:35:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/little-bin-plastic-stacking-bins-2-3-4-x-5-1-4-x-3-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:35:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-1196-1-4-inch-mpt-x-3-8-inch-fpt-reducer-adapter>: HTTP status code is not handled or not allowed
2026-01-10 18:35:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pedestal-for-premier-poppers>: HTTP status code is not handled or not allowed
2026-01-10 18:35:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hotdog-mini-cart-steamer>: HTTP status code is not handled or not allowed
2026-01-10 18:35:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-enclosed-satin-bulletin-board-48-in-w-x-36-in-h>: HTTP status code is not handled or not allowed
2026-01-10 18:35:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-starter-96inw-x-36ind-x-84inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:35:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-cal-flame-resistant-coveralls-s-tan-tcg02120857>: HTTP status code is not handled or not allowed
2026-01-10 18:35:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-hose-female-swivel-x-male-adapter-363-2522561-2-1-2-nh-x-2-1-2-npt-brass>: HTTP status code is not handled or not allowed
2026-01-10 18:35:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-hose-reel-cover-138-9-36-x-12-red-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 18:35:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mesh-with-drawstring-closure-orange-18-24-medium>: HTTP status code is not handled or not allowed
2026-01-10 18:35:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pistol-rack-51653-pr-for-closet-vault-ii-gun-cabinet-wire-rack-only-51653-s>: HTTP status code is not handled or not allowed
2026-01-10 18:35:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-ropeless-nylon-yellow-straight>: HTTP status code is not handled or not allowed
2026-01-10 18:35:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-polyester-mesh-wristlet-m-black-s01mc9xmd>: HTTP status code is not handled or not allowed
2026-01-10 18:35:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264214-90-degree-elbow-short-radius-3-8-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:35:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264221-90-degree-elbow-street-fitting-3-8-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:35:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-open-g-1-8-single-solenoid-valve-pilot-spr-return-220v-ac-5va-coil-led-connection>: HTTP status code is not handled or not allowed
2026-01-10 18:35:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-s-brass-removable-insert-for-eterna-cartridge-cold-left>: HTTP status code is not handled or not allowed
2026-01-10 18:35:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-s-brass-pre-rinse-assembly-44-w-24-riser>: HTTP status code is not handled or not allowed
2026-01-10 18:35:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-liner-20-bu-blue-tub-only>: HTTP status code is not handled or not allowed
2026-01-10 18:35:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-work-shirt-xl-navy-tcg01160222>: HTTP status code is not handled or not allowed
2026-01-10 18:35:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-open-g-1-2-single-solenoid-valve-pilot-spr-return-12v-dc-3w-coil-led-connection>: HTTP status code is not handled or not allowed
2026-01-10 18:35:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-58-102-amp-115v-1075rpm-reversible>: HTTP status code is not handled or not allowed
2026-01-10 18:35:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-security-stainless-steel-key-keeper-n1025949>: HTTP status code is not handled or not allowed
2026-01-10 18:35:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-18-ga-36-wx18-dx97-h-open-clip-style-5-shelf>: HTTP status code is not handled or not allowed
2026-01-10 18:35:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-starter-48inw-x-36ind-x-60inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:35:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-36inw-x-12ind-x-72inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:35:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-58-stock-115208-230v-1550rpm-18hp>: HTTP status code is not handled or not allowed
2026-01-10 18:35:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8460-containment-berm-foam-wall-12-feet-by-50-feet-22-ounce-pvc>: HTTP status code is not handled or not allowed
2026-01-10 18:35:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cfp4-25um-qualitative-cellulose-filter-paper-15-0cm-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:35:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-unassembled-storage-cabinet-recessed-handle36w-x-24d-x-72h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:35:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-hobby-craft-organizer-storage-kit-galvanized-black-32-x-32-x-9>: HTTP status code is not handled or not allowed
2026-01-10 18:35:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/281084-plastic-bonnet-for-blickman-supply>: HTTP status code is not handled or not allowed
2026-01-10 18:35:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10ab-x-2-security-sheet-metal-screw-flat-hex-socket-head-302hq-18-8-stainless-steel-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:35:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-pack-2-panels-green-metal-32-x-32-x-3-4>: HTTP status code is not handled or not allowed
2026-01-10 18:35:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-cabinet-shelf-for-24-deep-jumbo-48-cabinet-sand>: HTTP status code is not handled or not allowed
2026-01-10 18:35:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-shelf-heavy-duty-boltless-shelving-add-on-72inw-x-30ind-x-36inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:35:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/label-holders-4-in-6-in-clear-full-self-adhering>: HTTP status code is not handled or not allowed
2026-01-10 18:35:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-high-metal-indoor-outdoor-counter-height-stool-with-back-white>: HTTP status code is not handled or not allowed
2026-01-10 18:36:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-thru-deluxe-unassembled-steel-wardrobe-cabinet-36w-x-24d-x-78h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:36:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-2-single-solenoid-valve-ext-pilot-spring-return-g-1-4-110v-ac-5va-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 18:36:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-pack-2-panels-gray-metal-32-x-32-x-3-4>: HTTP status code is not handled or not allowed
2026-01-10 18:36:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-person-wall-mount-box-locker-12w-x-18d-x-12h-medium-grey>: HTTP status code is not handled or not allowed
2026-01-10 18:36:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-master-workbench-kit-blue-white-96-x-32-x-9>: HTTP status code is not handled or not allowed
2026-01-10 18:36:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-retardant-silicone-foam-sheet-no-adhesive-1-4-x-36-x-36>: HTTP status code is not handled or not allowed
2026-01-10 18:36:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/label-holders-3-8-in-6-in-clear-self-adheres>: HTTP status code is not handled or not allowed
2026-01-10 18:36:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9055 pages (at 98 pages/min), scraped 3833 items (at 48 items/min)
2026-01-10 18:36:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/label-holders-1-1-2-in-6-in-clear-removable>: HTTP status code is not handled or not allowed
2026-01-10 18:36:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carson-optical-mp-842is-carson-monopix-8x42mm-waterproof-monocular-w-smartphone-digiscoping-adapter>: HTTP status code is not handled or not allowed
2026-01-10 18:36:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-3246-3-light-ceiling-semi-flush-frosted-white-brushed-nickel-15-25w-x-15-5h>: HTTP status code is not handled or not allowed
2026-01-10 18:36:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aero-one-bowl-ss-sink-18-x-18>: HTTP status code is not handled or not allowed
2026-01-10 18:36:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lacer-face-strip-fsman2-60>: HTTP status code is not handled or not allowed
2026-01-10 18:36:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-king-sk3000-pallet-rack-108w-x-48d-x-96h-4040-lbs-cap-per-level-add-on-unit>: HTTP status code is not handled or not allowed
2026-01-10 18:36:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-king-sk3000-pallet-rack-96w-x-42d-x-120h-4900-lbs-cap-per-level-starter-unit>: HTTP status code is not handled or not allowed
2026-01-10 18:36:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-aluminum-female-short-shank-coupling-with-brass-nut>: HTTP status code is not handled or not allowed
2026-01-10 18:36:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-exit-sign-self-powered-single-face>: HTTP status code is not handled or not allowed
2026-01-10 18:36:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10ab-x-1-1-2-security-sheet-metal-screw-flat-hex-socket-head-302hq-18-8-ss-usa-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:36:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-16-inch-1-inch-stainless-steel-worm-gear-clamp-with-1-2-inch-band>: HTTP status code is not handled or not allowed
2026-01-10 18:36:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dagr-af-safety-glasses-black-anti-fog-clear-lens-52003>: HTTP status code is not handled or not allowed
2026-01-10 18:36:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/trade-legal-ntep-approved-pallet-jack-scale-truck-27-x-46-forks-5000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:36:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digital-power-distribution-unit-vertical-pdu-16-nema5-15r-15a>: HTTP status code is not handled or not allowed
2026-01-10 18:36:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62-122-trax-1-module-vanity-wall-frosted-glass-hazel-bronze-7w-x-20h>: HTTP status code is not handled or not allowed
2026-01-10 18:36:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/77-191-8-light-vanity-wall-strip-polished-brass-48w-x-4-75h>: HTTP status code is not handled or not allowed
2026-01-10 18:36:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-4902-adams-1-light-outdoor-wall-frosted-rustic-bronze-6-125w-x-18-25h>: HTTP status code is not handled or not allowed
2026-01-10 18:36:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8000va-smart-online-ups-w-hot-swap-pdu-and-step-down-trans-208-240v>: HTTP status code is not handled or not allowed
2026-01-10 18:36:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-40-x-3-4-security-machine-screw-button-torx-head-302hq-stainless-steel-ft-unc-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:36:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omega-womens-safety-work-boots-steel-toe-6h-size-75w-black>: HTTP status code is not handled or not allowed
2026-01-10 18:36:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-in-x-30-in-work-bench-base-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:36:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-in-x-30-in-work-bench-base-tan>: HTTP status code is not handled or not allowed
2026-01-10 18:36:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nova-eh-20-womens-safety-work-boots-steel-toe-18h-size-9w-black>: HTTP status code is not handled or not allowed
2026-01-10 18:36:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-t-shirt-short-sleeve-1-pocket-fl-lime-medium>: HTTP status code is not handled or not allowed
2026-01-10 18:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/vanity_bath_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:36:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omega-womens-safety-work-boots-steel-toe-6h-size-9-black>: HTTP status code is not handled or not allowed
2026-01-10 18:36:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011569-bearing-kit>: HTTP status code is not handled or not allowed
2026-01-10 18:36:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-4965-boxwood-1-light-outdoor-wall-clear-beveled-rustic-bronze-9-875w-x-19h>: HTTP status code is not handled or not allowed
2026-01-10 18:36:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gravity-womens-safety-work-boots-steel-toe-4h-size-7w-black>: HTTP status code is not handled or not allowed
2026-01-10 18:36:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-coat-rack-with-bars-wall-mount-60-w-x-24-d-x-6-h>: HTTP status code is not handled or not allowed
2026-01-10 18:36:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/77-700-1-light-flood-light-w-adjust-swivel-black-4-5w-x-8h>: HTTP status code is not handled or not allowed
2026-01-10 18:36:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2661009-brush-double-ended-for-taylor-freezer>: HTTP status code is not handled or not allowed
2026-01-10 18:36:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelving-36x12x60-with-4-shelves-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:36:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/76-658-1-light-landscape-fixt-antique-verdi-5-5w>: HTTP status code is not handled or not allowed
2026-01-10 18:36:46 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/vanity_bath_lights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/vanity_bath_lights landed on page that is not a product page.
2026-01-10 18:36:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelving-36x18x60-with-4-shelves-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:36:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-aluminum-wheel-riser-48-x-24-x-6>: HTTP status code is not handled or not allowed
2026-01-10 18:36:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mover-tricycle-500-cap-3speed-coaster-brake-w-20-in-wheels-black>: HTTP status code is not handled or not allowed
2026-01-10 18:36:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/surface-mount-flexible-stake-24-in-h-white>: HTTP status code is not handled or not allowed
2026-01-10 18:36:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reflector-3-in-w-x-6-in-h-white>: HTTP status code is not handled or not allowed
2026-01-10 18:36:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-stem-caster-3-dia-duralastomer-with-1-1-2-h-stem>: HTTP status code is not handled or not allowed
2026-01-10 18:36:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hss-tmx-jewelers-saw-6-inch-dia-x-064-inch-face-x-1-inch-hole-x-232-teeth>: HTTP status code is not handled or not allowed
2026-01-10 18:36:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-high-letter-starter-empty-black>: HTTP status code is not handled or not allowed
2026-01-10 18:36:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-boltless-shelving-starter-48inw-x-18ind-x-36inh-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:36:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buckhorn-tl42290400sg000-42x29-agricultural-bulk-box-lid-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:36:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-285-3-light-ceiling-flush-mount-w-alabaster-glass-brushed-nickel-17w-x-6h>: HTTP status code is not handled or not allowed
2026-01-10 18:37:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-30-18-gauge-stainless-steel-workbench>: HTTP status code is not handled or not allowed
2026-01-10 18:37:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keyway-broach-metric-hss-type-a-3mm>: HTTP status code is not handled or not allowed
2026-01-10 18:37:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merchandiser-freezer-glass-door-23-cu-ft-black>: HTTP status code is not handled or not allowed
2026-01-10 18:37:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-471-car-port-2-light-flush-mount-texture-frosted-polished-brass-9-25w>: HTTP status code is not handled or not allowed
2026-01-10 18:37:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hss-tmx-involute-gear-cutters-14-5-pressure-angle-dp-32-1-number-6>: HTTP status code is not handled or not allowed
2026-01-10 18:37:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mg-electronics-led45-magnifier-lamp-5-diopter-32-inch-reach-white>: HTTP status code is not handled or not allowed
2026-01-10 18:37:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-986-cornerstone-1-light-wall-lantern-w-clear-seed-glass-old-bronze-7w-x-18h>: HTTP status code is not handled or not allowed
2026-01-10 18:37:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9618a-replacement-blower-motor>: HTTP status code is not handled or not allowed
2026-01-10 18:37:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-boltless-shelving-starter-36inw-x-24ind-x-96inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:37:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9153 pages (at 98 pages/min), scraped 3878 items (at 45 items/min)
2026-01-10 18:37:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wet-look-floor-finish-5-gallon-pail>: HTTP status code is not handled or not allowed
2026-01-10 18:37:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/automotive-t-style-coupler-3-8-x-3-8-female-npt-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 18:37:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-24-w-7-step-steel-rolling-ladder-14-d-top-step-lock-style-a>: HTTP status code is not handled or not allowed
2026-01-10 18:37:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-4931-banyan-1-light-outdoor-hanging-clear-water-white-6-125w-x-10-75h>: HTTP status code is not handled or not allowed
2026-01-10 18:37:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-earth-glass-cleaner-gallon-bottle-four-bottles>: HTTP status code is not handled or not allowed
2026-01-10 18:37:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-16-w-2-step-steel-rolling-ladder-20-d-top-step-1>: HTTP status code is not handled or not allowed
2026-01-10 18:37:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-4-copper-fitting-x-press-w-90-176-long-turn-street-elbow>: HTTP status code is not handled or not allowed
2026-01-10 18:37:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neoprene-floor-mount-vibration-isolator-6-long-3-wide-white>: HTTP status code is not handled or not allowed
2026-01-10 18:37:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qt-pro-two-stage-air-compressor-5-hp-80gallon-vertical-200v-3-phase>: HTTP status code is not handled or not allowed
2026-01-10 18:37:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-liner-for-medium-ultra-filter-pad-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:37:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-100-ft-3000-psi-without-hose-hand-crank>: HTTP status code is not handled or not allowed
2026-01-10 18:37:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/od-630-906-hose-roller-guide>: HTTP status code is not handled or not allowed
2026-01-10 18:37:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cyclone-hand-chain-hoist-on-geared-trolley-1-ton-20-ft-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:37:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-rubber-mold-on-wheel-910-sa-10-dia-2-1-2w-1500-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/outdoor_lighting_fixtures/outdoor_area_lighting already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:37:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-ratio-led-area-light-12000l-100w-40k-type-3-dist-arm-mount-120-277v>: HTTP status code is not handled or not allowed
2026-01-10 18:37:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-boltless-shelving-starter-48inw-x-24ind-x-60inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:37:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cyclone-hand-chain-hoist-on-plain-trolley-10-ton-20-ft-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:37:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sb-app-connector-2-0-wire-gauge-350-amp-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:37:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alliance-hose-spiral-wrap-hose-guard-for-11-16-to-7-8-od-50>: HTTP status code is not handled or not allowed
2026-01-10 18:37:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cyclone-hand-chain-hoist-on-plain-trolley-12-ton-15-ft-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/casters_wheels/plate_casters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:37:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/giant-stackable-storage-bin-12-3-8x19-3-4x11-7-8-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:37:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011359-evaporator-coil-for-turbo-air-refrigeration>: HTTP status code is not handled or not allowed
2026-01-10 18:37:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-handtruck-fbal48-10fpn-double-handle-pneumatic-wheels-600-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:37:35 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/outdoor_lighting_fixtures/outdoor_area_lighting> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/outdoor_lighting_fixtures/outdoor_area_lighting landed on page that is not a product page.
2026-01-10 18:37:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-conductor-grounded-orange-cord-300v-1>: HTTP status code is not handled or not allowed
2026-01-10 18:37:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inside-stational-deck-dome-oven-pentagonal-exterior-39-gas-92500btu-120v-digital-control>: HTTP status code is not handled or not allowed
2026-01-10 18:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/casters_wheels/wheels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:37:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotating-deck-dome-oven-round-top-47-inside-deck-gas-92500btu-208-240v-digital-control>: HTTP status code is not handled or not allowed
2026-01-10 18:37:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-gallon-steel-drum-closed-head>: HTTP status code is not handled or not allowed
2026-01-10 18:37:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-extension-bracket-kit-for-ss-pickup-truck-dump-inserts>: HTTP status code is not handled or not allowed
2026-01-10 18:37:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/material-handling/casters_wheels/plate_casters>: HTTP status code is not handled or not allowed
2026-01-10 18:37:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/58-alloy-latching-j-hook-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:37:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/561391-self-tapping-water-valve>: HTTP status code is not handled or not allowed
2026-01-10 18:37:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6ft-aluminum-team-bench-without-back-portable>: HTTP status code is not handled or not allowed
2026-01-10 18:37:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-portable-heater-with-remote-7500-4700-watts-240v-1-phase>: HTTP status code is not handled or not allowed
2026-01-10 18:37:49 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/material-handling/casters_wheels/wheels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/material-handling/casters_wheels/wheels landed on page that is not a product page.
2026-01-10 18:37:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coil-lifter-1000-lb-capacity-14463>: HTTP status code is not handled or not allowed
2026-01-10 18:37:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/full-motion-and-pull-down-tv-wall-mount-for-43-in-73-in-tv-screen>: HTTP status code is not handled or not allowed
2026-01-10 18:37:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/266312-sheave-door-rear-steel-tire>: HTTP status code is not handled or not allowed
2026-01-10 18:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/outdoor_lighting_fixtures/wall_pack_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:37:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-sided-smoking-shelter-nbs0820bw-back-to-wall-17ft-2inw-x-7ftd-x-7ft-11inh-black>: HTTP status code is not handled or not allowed
2026-01-10 18:37:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-cabinet-with-removable-bins-39>: HTTP status code is not handled or not allowed
2026-01-10 18:37:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cyclone-hand-chain-hoist-on-low-headroom-geared-trolley-3-ton-15-ft-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:37:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coffing-lsb-ratchet-lever-hoist-1-ton-10-ft-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:37:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-3-shelf-boltless-shelving-starter-48inw-x-24ind-x-84inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:37:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-aluminum-cleaning-sanitation-cart-39-inch-l-x-21-inch-w-x-41-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 18:38:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-style-c-j-hook>: HTTP status code is not handled or not allowed
2026-01-10 18:38:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-ft-square-outdoor-tree-bench-expanded-metal-surface-mount-green>: HTTP status code is not handled or not allowed
2026-01-10 18:38:03 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/outdoor_lighting_fixtures/wall_pack_lights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/outdoor_lighting_fixtures/wall_pack_lights landed on page that is not a product page.
2026-01-10 18:38:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-aluminum-rolling-ladder-16-w-grip-step-30-handrails>: HTTP status code is not handled or not allowed
2026-01-10 18:38:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pivot-boom-forklift-jib-lift-crane-pb-jlt424-4000-lb-capacity-24-on-center-fork-pockets>: HTTP status code is not handled or not allowed
2026-01-10 18:38:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/light-to-medium-duty-service-door-double-panel-black-6ft-x-7ft>: HTTP status code is not handled or not allowed
2026-01-10 18:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/halogen_bulbs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:38:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-4-shelf-boltless-shelving-add-on-48inw-x-18ind-x-96inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:38:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-tricycle-rear-steel-box>: HTTP status code is not handled or not allowed
2026-01-10 18:38:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-depth-cardboard-corrugated-boxes-20l-x-12w-x-12h-kraft-pack-of-20>: HTTP status code is not handled or not allowed
2026-01-10 18:38:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9244 pages (at 91 pages/min), scraped 3916 items (at 38 items/min)
2026-01-10 18:38:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-86-inch-high-post-stainless-steel-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:38:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zipt88b2-8-channel-hd-tvi-dvr-and-8-bullet-camera-kit-2tb>: HTTP status code is not handled or not allowed
2026-01-10 18:38:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-line-single-track-seal-top-bag-with-hang-hole-4in-x-8in-2-mil-pkg-qty-1000>: HTTP status code is not handled or not allowed
2026-01-10 18:38:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dispense-rite-countertop-6-section-silverware-organizer>: HTTP status code is not handled or not allowed
2026-01-10 18:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/halogen_bulbs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:38:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26inx40in-safety-stance-mat-black-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:38:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012738-microswitch-for-merry-chef>: HTTP status code is not handled or not allowed
2026-01-10 18:38:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/halogen_bulbs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/halogen_bulbs landed on page that is not a product page.
2026-01-10 18:38:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35mr11-nfl-35w-halogen-w-sub-minature-2-pin-base>: HTTP status code is not handled or not allowed
2026-01-10 18:38:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100q-f-dc-100w-halogen-w-dc-bay-base>: HTTP status code is not handled or not allowed
2026-01-10 18:38:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protap-cutting-fluid-16-oz-pkg-of-12-30016p>: HTTP status code is not handled or not allowed
2026-01-10 18:38:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/legal-size-fireproof-file-cabinet-21-w-x-25-d-x-28-h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:38:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-density-mattress-bag-king-pkg-qty-100>: HTTP status code is not handled or not allowed
2026-01-10 18:38:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/advanced-instant-hand-sanitizer-12-oz-pump-bottle-12-carton-3659-12>: HTTP status code is not handled or not allowed
2026-01-10 18:38:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/halogen_bulbs>: HTTP status code is not handled or not allowed
2026-01-10 18:38:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torque-stick-1-5-16-3-4-drive-475-ft-lbs-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:38:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-lid-24-gallon-green>: HTTP status code is not handled or not allowed
2026-01-10 18:38:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cardboard-corrugated-boxes-46l-x-20w-x-12h-kraft-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 18:38:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheel-axle-size-5-8-8>: HTTP status code is not handled or not allowed
2026-01-10 18:38:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009824-drain-line-heater-19208v>: HTTP status code is not handled or not allowed
2026-01-10 18:38:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-mailers-9l-x-6w-x-2h-kraft-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 18:38:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-mailers-6-12l-x-3-14w-x-1-14h-kraft-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 18:38:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/homak-rd02065800-rs-pro-series-54-w-x-23-1-2-d-x-21-3-8-h-8-drawer-red-tool-chest>: HTTP status code is not handled or not allowed
2026-01-10 18:38:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kx20fr-3m-mc-20w-halogen-w-mini-can-base>: HTTP status code is not handled or not allowed
2026-01-10 18:38:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-chassis-jack-20-ton-heavy-duty>: HTTP status code is not handled or not allowed
2026-01-10 18:38:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apc-smart-ups-rt-surt192xlbp>: HTTP status code is not handled or not allowed
2026-01-10 18:38:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010281-water-curtain-for-manitowoc-machines>: HTTP status code is not handled or not allowed
2026-01-10 18:38:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apc-replacement-battery-rbc57>: HTTP status code is not handled or not allowed
2026-01-10 18:38:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-axle-jack-25-10-ton-2-stage-air>: HTTP status code is not handled or not allowed
2026-01-10 18:38:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pic-gauges-4-pressure-gauge-liquid-fill-10000-psi-all-stainless-steel-lower-mount-301l-402u>: HTTP status code is not handled or not allowed
2026-01-10 18:38:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ft36hl-830-env-36w-compact-fluorescent-w-2g11-base-warm-white>: HTTP status code is not handled or not allowed
2026-01-10 18:38:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5t2c-41-5w-compact-fluorescent-w-candelabra-base-cool-white>: HTTP status code is not handled or not allowed
2026-01-10 18:38:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-wall-corrugated-boxes-w-hand-holes-20l-x-20w-x-12h-kraft-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 18:38:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/separable-roller-follower-metric-nast40r-crowned-od-open-40-mm-bore-80-mm-od>: HTTP status code is not handled or not allowed
2026-01-10 18:38:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/-uca-u-channel-adaptor-bases-post-mount>: HTTP status code is not handled or not allowed
2026-01-10 18:38:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/110-ton-elite-ironworker-3-phase-380v-50-hz-elt110-3p380>: HTTP status code is not handled or not allowed
2026-01-10 18:38:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fc12t9-cw-rs-32w-fluorescent-w-4-pin-base-cool-white>: HTTP status code is not handled or not allowed
2026-01-10 18:38:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ivory-personal-bar-31oz-size-72>: HTTP status code is not handled or not allowed
2026-01-10 18:38:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-alcohol-hand-sanitizer-1-5-ml-single-use-250-packets-per-case>: HTTP status code is not handled or not allowed
2026-01-10 18:38:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/266168-latch-w-1-1-4-inch-strike>: HTTP status code is not handled or not allowed
2026-01-10 18:38:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-2>: HTTP status code is not handled or not allowed
2026-01-10 18:38:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locking-tire-sling-for-use-with-large-tires-up-to-39-6-500-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:38:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/disposable-nitrile-gloves-large-powder-free>: HTTP status code is not handled or not allowed
2026-01-10 18:38:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100-ton-deluxe-ironworker-3-phase-575v-w-hydraulic-accessory-pack-iw100dx-3p575-ac800>: HTTP status code is not handled or not allowed
2026-01-10 18:38:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-dividable-20>: HTTP status code is not handled or not allowed
2026-01-10 18:38:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/travira-48-backless-bench-tekwood-natural>: HTTP status code is not handled or not allowed
2026-01-10 18:38:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-153-deluxe-thermoplastic-coated-32-gallon-perforated-receptacle-w-flat-lid-base-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:38:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-accessory-short-divider-17>: HTTP status code is not handled or not allowed
2026-01-10 18:39:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ind-qlty-steel-wool-hand-pad-00-fine-126>: HTTP status code is not handled or not allowed
2026-01-10 18:39:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-max-xr-narrow-crown-stapler-kit-18-gauge-1-2-1-1-2-l-staple-li-ion-d-style>: HTTP status code is not handled or not allowed
2026-01-10 18:39:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sara-chandelier-light-fixture-5-candelabra-e12-base-sockets-60w-120v-gold>: HTTP status code is not handled or not allowed
2026-01-10 18:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:39:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straddle-type-floor-lock-for-lifts>: HTTP status code is not handled or not allowed
2026-01-10 18:39:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/counter-weight-drum-handler-battery-powered-90-h-24-leg-distance>: HTTP status code is not handled or not allowed
2026-01-10 18:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:39:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3ca9-flicker-3w-incandescent-w-medium-base>: HTTP status code is not handled or not allowed
2026-01-10 18:39:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uhmw-polyethylene-plastic-bar-3-8-thick-x-3-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 18:39:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/x10t3-1-4-10w-miniature-sealed-beams-w-festoon-base-12v>: HTTP status code is not handled or not allowed
2026-01-10 18:39:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9339 pages (at 95 pages/min), scraped 3956 items (at 40 items/min)
2026-01-10 18:39:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylinder-storage-manual-1-door-vertical-cabinet-1>: HTTP status code is not handled or not allowed
2026-01-10 18:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:39:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-filtered-exhaust-fan-direct-drive-totally-enclosed-1-phase-1-hp>: HTTP status code is not handled or not allowed
2026-01-10 18:39:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/krp-150fr-fire-rated-access-door-for-wall-ceil-paddle-handle-36wx36h-krpp3636ph>: HTTP status code is not handled or not allowed
2026-01-10 18:39:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 18:39:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uhmw-polyethylene-plastic-rod-4-diameter-x-3-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:39:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-i-hss-straight-flute-chucking-reamer-6350>: HTTP status code is not handled or not allowed
2026-01-10 18:39:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-2-thick-x-24-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 18:39:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 18:39:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/158-3-36w-miniature-sealed-beams-w-mini-wedge-base>: HTTP status code is not handled or not allowed
2026-01-10 18:39:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-pin-compact-fluorescent-light-bulb-2g11-base-3500k-40w-neutral-white-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 18:39:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uhmw-polyethylene-plastic-rod-2-diameter-x-3-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:39:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 18:39:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-hd-silent-pneumatic-turbine-vibrator-ccf-7000>: HTTP status code is not handled or not allowed
2026-01-10 18:39:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-silent-pneumatic-turbine-vibrator-vs-160>: HTTP status code is not handled or not allowed
2026-01-10 18:39:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/511246-pilot-burner>: HTTP status code is not handled or not allowed
2026-01-10 18:39:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-heavy-duty-electric-vibrator-2pcd-200-1>: HTTP status code is not handled or not allowed
2026-01-10 18:39:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-1-4-thick-x-1-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 18:39:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lodestar-vs-electric-chain-hoist-1-8-ton-10-foot-lift-5-3-32-fpm-115-1-60-3-step-iv-control>: HTTP status code is not handled or not allowed
2026-01-10 18:39:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-round-hanging-pendant-light-fixture-25w-304050k-120v-20l-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 18:39:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/padded-dividers-for-933-case-933-divi>: HTTP status code is not handled or not allowed
2026-01-10 18:39:30 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock landed on page that is not a product page.
2026-01-10 18:39:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/923-series-airtight-watertight-case-w-divider-923-2007-18-5-8-l-x-14-3-8-w-x-6-5-16-h-graphite>: HTTP status code is not handled or not allowed
2026-01-10 18:39:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lodestar-vs-electric-chain-hoist-1-ton-10-foot-lift-1-3-8-fpm-115-1-60-2-step-control>: HTTP status code is not handled or not allowed
2026-01-10 18:39:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/250-3-8-diameter-7x19-galvanized-aircraft-cable>: HTTP status code is not handled or not allowed
2026-01-10 18:39:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-silent-pneumatic-turbine-vibrator-bbs-100>: HTTP status code is not handled or not allowed
2026-01-10 18:39:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/250-5-8-dia-6x26-extra-improved-plow-steel-galvanized-wire-rope-independent-wire-rope-center>: HTTP status code is not handled or not allowed
2026-01-10 18:39:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-steel-reel-holder-workbench-72-w>: HTTP status code is not handled or not allowed
2026-01-10 18:39:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-flush-mount-ceiling-light-fixture-60w-11-14-dia-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 18:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/fluorescent_linear_bulbs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:39:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unisan-lambswool-extendable-duster-handle-extends-35-48-assort-colors>: HTTP status code is not handled or not allowed
2026-01-10 18:39:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/milton-s-218-m-style-industrial-swivel-coupler-and-plug-kit-6-piece-6-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:39:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ushio-f39t5ho-835-34in85cri>: HTTP status code is not handled or not allowed
2026-01-10 18:39:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-bag-35-lb-base-weight-brown-kraft-6-6-x-3-58-x-11-116-500-bundle>: HTTP status code is not handled or not allowed
2026-01-10 18:39:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackable-skid-box-green-62x31x21>: HTTP status code is not handled or not allowed
2026-01-10 18:39:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-acetal-plastic-bar-1-thick-x-2-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 18:39:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-1-thick-x-1-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 18:39:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/milton-s-732w-m-style-industrial-plug-3-8-fnpt-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:39:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-par16-recessed-floodlight-bulb-e26-base-6w-500-lumens-30k-warm-white-pk-of-6>: HTTP status code is not handled or not allowed
2026-01-10 18:39:50 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/fluorescent_linear_bulbs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/fluorescent_linear_bulbs landed on page that is not a product page.
2026-01-10 18:39:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/840-style-woven-wire-panels-3w-x-10h>: HTTP status code is not handled or not allowed
2026-01-10 18:39:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chillits-6710ct-evaporative-cooling-triangle-hat-with-cooling-towel-lime-12586>: HTTP status code is not handled or not allowed
2026-01-10 18:39:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-g1sc-162-b>: HTTP status code is not handled or not allowed
2026-01-10 18:39:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/composite-reel-spring-rewind-with-1-4-hose-3>: HTTP status code is not handled or not allowed
2026-01-10 18:39:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reel-1>: HTTP status code is not handled or not allowed
2026-01-10 18:39:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-16-w-2-step-steel-rolling-ladder-20-d-top-step-2>: HTTP status code is not handled or not allowed
2026-01-10 18:39:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-a19-light-bulb-e26-base-9w-800-lumens-2700k-warm-white-pack-of-3>: HTTP status code is not handled or not allowed
2026-01-10 18:39:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/upright-angled-broom-green-flagged-polypropylene-with-steel-handle>: HTTP status code is not handled or not allowed
2026-01-10 18:40:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-s14-filament-light-bulb-e26-base-2w-200-lumens-2700k-warm-white-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 18:40:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-set-screw-collar-gmc-05-b>: HTTP status code is not handled or not allowed
2026-01-10 18:40:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60x30-stainless-square-edge-mobile-power-apron-production-bench-blue-32313751>: HTTP status code is not handled or not allowed
2026-01-10 18:40:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-emergency-exit-sign-with-90-minute-battery-power-back-up-24w-120-277v-white>: HTTP status code is not handled or not allowed
2026-01-10 18:40:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m42-x-4-5-d10-taper-chamfer-iso-metric-hss-tm-x-hand-tap-ground-rh-6-flutes>: HTTP status code is not handled or not allowed
2026-01-10 18:40:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-metric-hss-tm-x-hand-taps-set-of-3-m3-5-x-0-60-taper-plug-and-bottoming-chamfer>: HTTP status code is not handled or not allowed
2026-01-10 18:40:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-outdoor-wall--bulkhead-round-light-fixture-20w-30k40k50k-120-277v-black>: HTTP status code is not handled or not allowed
2026-01-10 18:40:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-decorative-outdoor-fixture-100w-10-dia-white-globeblack-base>: HTTP status code is not handled or not allowed
2026-01-10 18:40:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9433 pages (at 94 pages/min), scraped 3996 items (at 40 items/min)
2026-01-10 18:40:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72x30-maple-square-edge-power-apron-production-bench-blue-32313819>: HTTP status code is not handled or not allowed
2026-01-10 18:40:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/number-10-32-h3-set-of-3-one-each-taper-plug-and-bottoming-chamfer-hss-hand-tap-ground-rh-4-flutes>: HTTP status code is not handled or not allowed
2026-01-10 18:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:40:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20-x-1-2-wing-screw-1-1-4-head-width-malleable-iron-zinc-usa-pkg-of-25>: HTTP status code is not handled or not allowed
2026-01-10 18:40:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/florsheimfe690-mens-quick-release-6-metatarsal-work-boot-black-size-11-ee-wide>: HTTP status code is not handled or not allowed
2026-01-10 18:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:40:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reebokrb4444-womens-waterproof-sport-hiker-brown-size-10-w>: HTTP status code is not handled or not allowed
2026-01-10 18:40:16 [py.warnings] (PID: 62) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2026-01-10 18:40:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/faultless-swivel-plate-caster-6-polyolefin-wheel>: HTTP status code is not handled or not allowed
2026-01-10 18:40:17 [scrapy.extensions.feedexport] (PID: 62) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:4
2026-01-10 18:40:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-sheet-smarttouch-three-hole-punch-9-32-holes-black-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:40:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/faultless-rigid-plate-caster-5-polyurethane-wheel-2>: HTTP status code is not handled or not allowed
2026-01-10 18:40:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seo40072-40-hp-oil-less-scroll-compressor-tankless-116-psi-3-phase-208v>: HTTP status code is not handled or not allowed
2026-01-10 18:40:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combination-tm-x-drill-and-tap-hss-10-24-nc-h3>: HTTP status code is not handled or not allowed
2026-01-10 18:40:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set15072-15-hp-oil-less-scroll-compressor-tankless-116-psi-3-phase-208v>: HTTP status code is not handled or not allowed
2026-01-10 18:40:22 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets landed on page that is not a product page.
2026-01-10 18:40:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-valve-solenoid-1-8-nptf-3-port-2-pos-normally-clsd-24vdc-free-to-atmosphere-exh>: HTTP status code is not handled or not allowed
2026-01-10 18:40:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/cabinets/garage_cabinets>: HTTP status code is not handled or not allowed
2026-01-10 18:40:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/law-og112afotg-over-the-glass-frame-gray-anti-fog-lens-silver-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/downlights_track_lighting already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:40:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-speed-bump-with-cable-protection-and-hardware-120-inch-long>: HTTP status code is not handled or not allowed
2026-01-10 18:40:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-sign-visitor-parking-only-08mm-thick-1>: HTTP status code is not handled or not allowed
2026-01-10 18:40:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/full-brim-hard-hat-sun-shield-for-msa-v-gard-a-s4-m>: HTTP status code is not handled or not allowed
2026-01-10 18:40:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aah-48rbmag2-wr-storage-cabinet-all-welded-48-wx18-dx78-h-wine-red>: HTTP status code is not handled or not allowed
2026-01-10 18:40:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-24-w-5-step-steel-rolling-ladder-14-d-top-step-w-cal-osha-handrail-cal-fsh526p>: HTTP status code is not handled or not allowed
2026-01-10 18:40:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/made-in-usa-o-1-oil-hardening-drill-rod-7mm>: HTTP status code is not handled or not allowed
2026-01-10 18:40:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-set-screw-collar-gmc-03-ss>: HTTP status code is not handled or not allowed
2026-01-10 18:40:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-vertical-file-legal-size-2-drawer-desert-putty-18w-x-25d-x-29h>: HTTP status code is not handled or not allowed
2026-01-10 18:40:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011327-control-board-for-manitowoc-machines>: HTTP status code is not handled or not allowed
2026-01-10 18:40:36 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/downlights_track_lighting> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/downlights_track_lighting landed on page that is not a product page.
2026-01-10 18:40:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/venture-patio-umbrella-with-bronze-pole-108w-olefin-graywhite-stripe-fabric>: HTTP status code is not handled or not allowed
2026-01-10 18:40:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curvo-modern-led-wall-sconce-vanity-light-fixture-10w-650-lumens-4-34l-black>: HTTP status code is not handled or not allowed
2026-01-10 18:40:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-linear-bar-vanity-light-fixture-20w-1400-lumens-18l-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 18:40:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-24-w-steel-safety-angle-rolling-ladder-w-handrails-grip-tread-w-cal-osha-handrail-cal-sw732g>: HTTP status code is not handled or not allowed
2026-01-10 18:40:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/newport-patio-umbrella-with-silver-pole-108w-sunbrella-1a-navy-fabric>: HTTP status code is not handled or not allowed
2026-01-10 18:40:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conntek-60141-20-amp-assembly-straight-blade-plug-with-nema-5-20p-male-end>: HTTP status code is not handled or not allowed
2026-01-10 18:40:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fs-227-h-grn-storage-cabinet-all-welded-27-wx15-dx72-h-hunter-green>: HTTP status code is not handled or not allowed
2026-01-10 18:40:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-deck-truck-48-l-x-30-w-1400-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:40:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-deck-truck-72-l-x-30-w-1400-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:40:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sidekick-3769jc>: HTTP status code is not handled or not allowed
2026-01-10 18:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:40:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-deck-truck-60-l-x-30-w-2400-lb-capacity-with-ergo-handle>: HTTP status code is not handled or not allowed
2026-01-10 18:40:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-steel-safety-rolling-ladder-w-weight-actuated-lock-24-w-perforated-step-orange-w-cal-osha-handrail-cal-wa073214p-o>: HTTP status code is not handled or not allowed
2026-01-10 18:40:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-cable-ties-uv-black-3-50-pieces>: HTTP status code is not handled or not allowed
2026-01-10 18:40:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-365218-pt-grn-bookcase-all-welded-36-wx18-dx52-h-pastel-green>: HTTP status code is not handled or not allowed
2026-01-10 18:40:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-365218-l-grn-bookcase-all-welded-36-wx18-dx52-h-leaf-green>: HTTP status code is not handled or not allowed
2026-01-10 18:40:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zip-a-duct-12in-gray-inlet-section>: HTTP status code is not handled or not allowed
2026-01-10 18:40:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-365213-ts-bookcase-all-welded-36-wx13-dx52-h-tropic-sand>: HTTP status code is not handled or not allowed
2026-01-10 18:40:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-step-steel-safety-rolling-ladder-w-weight-actuated-lock-24-w-expanded-step-orange-w-cal-osha-handrail-cal-wa093214x-o>: HTTP status code is not handled or not allowed
2026-01-10 18:40:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergotron-ds100-triple-monitor-desk-stand>: HTTP status code is not handled or not allowed
2026-01-10 18:40:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps landed on page that is not a product page.
2026-01-10 18:40:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-w-x-16-h-x-1-d-pleated-merv-8-standard-capacity-air-filter-global-industrial>: HTTP status code is not handled or not allowed
2026-01-10 18:41:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergotron-wm-low-profile-wall-mount>: HTTP status code is not handled or not allowed
2026-01-10 18:41:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aah-48rb-pt-grn-storage-cabinet-all-welded-48-wx18-dx72-h-pastel-green>: HTTP status code is not handled or not allowed
2026-01-10 18:41:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-vis-fr-control-2-0-short-sleeve-tee-type-r-class-2-mdt>: HTTP status code is not handled or not allowed
2026-01-10 18:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/retail_fixtures_displays_equipment/displays_display_racks/gondola_shelving already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:41:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-vis-fr-control-2-0-short-sleeve-tee-type-r-class-3-xl>: HTTP status code is not handled or not allowed
2026-01-10 18:41:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-367218-pt-grn-bookcase-all-welded-36-wx18-dx72-h-pastel-green>: HTTP status code is not handled or not allowed
2026-01-10 18:41:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wood-folding-table-54-inch-round-vinyl-edge-titan-series>: HTTP status code is not handled or not allowed
2026-01-10 18:41:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-aluminum-platform-step-ladder>: HTTP status code is not handled or not allowed
2026-01-10 18:41:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-step-steel-safety-rolling-ladder-w-weight-actuated-lock-24-w-serrated-step-orange-w-cal-osha-handrail-cal-wa123214g-o>: HTTP status code is not handled or not allowed
2026-01-10 18:41:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gray-relief-blanket>: HTTP status code is not handled or not allowed
2026-01-10 18:41:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9527 pages (at 94 pages/min), scraped 4035 items (at 39 items/min)
2026-01-10 18:41:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aquatic-eg-plastic-spineboard-with-head-blocks-and-straps>: HTTP status code is not handled or not allowed
2026-01-10 18:41:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-step-stock-picking-ladder-grip-step>: HTTP status code is not handled or not allowed
2026-01-10 18:41:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss-hose-braid-w-150-fixed-x-floating-fl-8-x-24>: HTTP status code is not handled or not allowed
2026-01-10 18:41:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/foodservice/retail_fixtures_displays_equipment/displays_display_racks/gondola_shelving>: HTTP status code is not handled or not allowed
2026-01-10 18:41:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sterile-alcohol-prep-pads-200-pcs>: HTTP status code is not handled or not allowed
2026-01-10 18:41:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/junior-low-handle-rollator-walker-with-padded-seat-and-backrest-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:41:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maah-48722rb-c-mobile-cabinet-all-welded-48-wx24-dx72-h-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 18:41:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-pilaster-w-shoe-24w-x-82h-cream>: HTTP status code is not handled or not allowed
2026-01-10 18:41:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aj730a-reusable-roof-anchor-fixed-310-cap-lbs>: HTTP status code is not handled or not allowed
2026-01-10 18:41:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-throw-bag-with-50-yellow-rope-with-kemp-bengal-safety-whistle>: HTTP status code is not handled or not allowed
2026-01-10 18:41:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-outward-swing-partition-door-w-hardware-26w-dark-khaki>: HTTP status code is not handled or not allowed
2026-01-10 18:41:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-18w-x-82h-azure>: HTTP status code is not handled or not allowed
2026-01-10 18:41:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-light-folding-transport-chair-with-carry-bag>: HTTP status code is not handled or not allowed
2026-01-10 18:41:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bl-364pt-counter-high-storage-cabinet-w--plastic-top-all-welded-36x18x42-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 18:41:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/remote-speaker-microphone-with-3-5mm-audio-jack-for-ht-series-portable-radios>: HTTP status code is not handled or not allowed
2026-01-10 18:41:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-locker-sloping-top-36-w-x-15-d-sand>: HTTP status code is not handled or not allowed
2026-01-10 18:41:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-rear-a-for-minuteman-172273>: HTTP status code is not handled or not allowed
2026-01-10 18:41:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s104027-wire-rope-sling-1-1-2-x-12-eye-and-eye-32000-42000-84000-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:41:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hs65nr-x03s-high-noise-reduction-two-way-radio-headset-over-the-head-dual-muff>: HTTP status code is not handled or not allowed
2026-01-10 18:41:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-rear-for-nobles-tennant-1045384>: HTTP status code is not handled or not allowed
2026-01-10 18:41:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-closed-linear-bearing-wresin-retainer-sw4g-14id-075l>: HTTP status code is not handled or not allowed
2026-01-10 18:41:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bradley-lavatory-system-high-on-left-and-right>: HTTP status code is not handled or not allowed
2026-01-10 18:41:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-closed-linear-bearing-wresin-retainer-sws8g-12id-125l>: HTTP status code is not handled or not allowed
2026-01-10 18:41:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-closed-linear-bearing-wseals-sws20uu-14id-2625l>: HTTP status code is not handled or not allowed
2026-01-10 18:41:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bradley-drench-hose-8-ft-eyewash-mount-abs-head-s19-430eh>: HTTP status code is not handled or not allowed
2026-01-10 18:41:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bradley-eye-wash-station-s19-210>: HTTP status code is not handled or not allowed
2026-01-10 18:41:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-transfer-table-with-3-centers-12800-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:41:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bradley-eye-wash-station-s19-220dc>: HTTP status code is not handled or not allowed
2026-01-10 18:41:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cable-tensiometer-set-child-165-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:41:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-5w-x-82h-almond>: HTTP status code is not handled or not allowed
2026-01-10 18:41:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bishamon-mobilift-battery-powered-scissor-lift-table-1100lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:41:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1818-7-8-hss-heavy-duty-sand-blasted-118-point-carbide-tipped-masonry-drill>: HTTP status code is not handled or not allowed
2026-01-10 18:41:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-pallet-40x48x5-1-4-four-way>: HTTP status code is not handled or not allowed
2026-01-10 18:41:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-piece-digital-hydraulic-hand-evaluation-set-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:41:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-hose-end-drain-cap-insert-for-nobles-tennant-1218955>: HTTP status code is not handled or not allowed
2026-01-10 18:41:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gray-elevated-plastic-box-truck-4-bushel-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:41:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-signs-caution-do-not-operate-vinyl-10-h-x-14-w>: HTTP status code is not handled or not allowed
2026-01-10 18:41:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/950-series-heavy-duty-closer-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:41:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-rear-a-for-nobles-tennant-1025336>: HTTP status code is not handled or not allowed
2026-01-10 18:41:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-signs-notice-cylinders-must-be-chained-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:41:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b151052-5-double-leg-chain-sling-w-sling-hook>: HTTP status code is not handled or not allowed
2026-01-10 18:41:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1823-3-8-heavy-duty-steam-oxide-power-wood-bits-drill>: HTTP status code is not handled or not allowed
2026-01-10 18:41:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd-cyl-locksets-entry-lock-stainless-steel-key-different>: HTTP status code is not handled or not allowed
2026-01-10 18:41:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snap-lock-hard-hat-white>: HTTP status code is not handled or not allowed
2026-01-10 18:42:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s152058-2-poly-web-sling-endless-5000-6400-12800-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:42:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-partition-panel-wo-brackets-5712w-folkstone-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:42:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1877-14-00mm-black-gold-118-point-3-flat-1-2-reduced-shank-silver-deming-drill>: HTTP status code is not handled or not allowed
2026-01-10 18:42:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-partition-panel-wo-brackets-5912w-pepper-dust>: HTTP status code is not handled or not allowed
2026-01-10 18:42:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-climax-1c-206>: HTTP status code is not handled or not allowed
2026-01-10 18:42:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-two-piece-clamping-collar-n2c-series-climax-n2c-062>: HTTP status code is not handled or not allowed
2026-01-10 18:42:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sk3000-174-structural-channel-pallet-rack-3-x-72-channel-beam-pair>: HTTP status code is not handled or not allowed
2026-01-10 18:42:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u-shaped-reception-station-with-window-88w-x-44d-x-44h-cherry-counter-blue-panel>: HTTP status code is not handled or not allowed
2026-01-10 18:42:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9627 pages (at 100 pages/min), scraped 4083 items (at 48 items/min)
2026-01-10 18:42:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edge-sealing-acrylic-lacquer-250-millaliter-non-flammable-83-0783>: HTTP status code is not handled or not allowed
2026-01-10 18:42:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluorinated-hdpe-jerricans-with-closure-10-liter-case-of-6>: HTTP status code is not handled or not allowed
2026-01-10 18:42:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-couplings-recessed-screw-w-keyway-cc-series-climax-2cc-062-050-kw>: HTTP status code is not handled or not allowed
2026-01-10 18:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/lockers/standard_lockers/plastic_standard_lockers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:42:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-front-for-nilfisk-advance-56391355-nilfisk-advance-56391342>: HTTP status code is not handled or not allowed
2026-01-10 18:42:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcr-safety-9378k-cut-pro-153-7-gauge-kevlar-174-synthetic-sleeve-18-thumb-slot>: HTTP status code is not handled or not allowed
2026-01-10 18:42:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-sided-frame-18x48-nexelon-1>: HTTP status code is not handled or not allowed
2026-01-10 18:42:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1896-13-00mm-hss-heavy-duty-steam-oxide-135-split-point-screw-machine-drill>: HTTP status code is not handled or not allowed
2026-01-10 18:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/drilling_hole_making/metalworking_drill_bits/screw_machine_length_drills already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:42:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/side-broom-w-water-resistant-bristles-for-km-70-20-km-70-30-6-966-005-0>: HTTP status code is not handled or not allowed
2026-01-10 18:42:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1898-5-10mm-hss-general-purpose-bright-118-point-jobber-length-drill>: HTTP status code is not handled or not allowed
2026-01-10 18:42:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dropper-bottles-with-control-dispensing-tip-15ml-case-of-25>: HTTP status code is not handled or not allowed
2026-01-10 18:42:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-industry-standard-clamping-couplings-climax-2iscc-037-037-s>: HTTP status code is not handled or not allowed
2026-01-10 18:42:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/lockers/standard_lockers/plastic_standard_lockers>: HTTP status code is not handled or not allowed
2026-01-10 18:42:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-unground-carbide-blank-316x716x1316-1310>: HTTP status code is not handled or not allowed
2026-01-10 18:42:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1872-tn-7-32-hss-heavy-duty-tin-135-hss-heavy-duty-parabolic-jobber-length-drill>: HTTP status code is not handled or not allowed
2026-01-10 18:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/tables/laboratory_tables already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:42:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-shaped-reception-station-with-window-and-raceway-116w-x-80d-x-46h-cherry-counter-blue-panel>: HTTP status code is not handled or not allowed
2026-01-10 18:42:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/machining/drilling_hole_making/metalworking_drill_bits/screw_machine_length_drills>: HTTP status code is not handled or not allowed
2026-01-10 18:42:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-cotton-flame-resistant-henley-shirt-l-grey>: HTTP status code is not handled or not allowed
2026-01-10 18:42:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/science-table-phenolic-top-adjustable-height-24w-x-72l-x-29-41h-black-oak>: HTTP status code is not handled or not allowed
2026-01-10 18:42:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/52330-dagr-safety-glasses-kryptek-framesmoke-lens>: HTTP status code is not handled or not allowed
2026-01-10 18:42:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/putf-6b-flat-tong-pc-6l-beige-plastic>: HTTP status code is not handled or not allowed
2026-01-10 18:42:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-panel-wo-brackets-5412w-black>: HTTP status code is not handled or not allowed
2026-01-10 18:42:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phenolic-black-core-partition-panel-wo-brackets-5712w-folkstone-celesta>: HTTP status code is not handled or not allowed
2026-01-10 18:42:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-g-10-fr-4-garolite-rod-1-1-2-diameter-x-1-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:42:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-front-for-factory-cat-39-755l>: HTTP status code is not handled or not allowed
2026-01-10 18:42:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/550-1-8-cobalt-heavy-duty-straw-135-split-point-jobber-length-drill>: HTTP status code is not handled or not allowed
2026-01-10 18:42:38 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/tables/laboratory_tables> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/tables/laboratory_tables landed on page that is not a product page.
2026-01-10 18:42:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-climax-h2c-325-s>: HTTP status code is not handled or not allowed
2026-01-10 18:42:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pfsh-c-cover-for-pfsh-series>: HTTP status code is not handled or not allowed
2026-01-10 18:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_partitions_stalls/polymer_bathroom_partitions already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:42:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40401-2-lxl-extreme-sport-life-vest-blue-largex-large>: HTTP status code is not handled or not allowed
2026-01-10 18:42:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40401-2-sm-extreme-sport-life-vest-blue-smallmedium>: HTTP status code is not handled or not allowed
2026-01-10 18:42:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-carbon-fiber-sheet-twill-weave-1-32-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 18:42:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/13-x-10-x-10-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:42:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/abc-industries-enviroduct-15wk-portable-heater-duct-16-dia-x-25l-x-7-pitch-black>: HTTP status code is not handled or not allowed
2026-01-10 18:42:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/starter-panel-to-wallpanel-to-pilaster-bracket-kit-polymeraluminum-stirrup>: HTTP status code is not handled or not allowed
2026-01-10 18:42:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-safety-helmet-novent-fas-trac-iii-pivot-ansi-csa-en397-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/glass_cleaners already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:42:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-x-8-x-6-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:42:50 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_partitions_stalls/polymer_bathroom_partitions> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_partitions_stalls/polymer_bathroom_partitions landed on page that is not a product page.
2026-01-10 18:42:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedcartt-24-48-63-back-to-back-40-cells-10-11-11>: HTTP status code is not handled or not allowed
2026-01-10 18:42:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o-ir-higher-performance-polyolefin-cf-shrink-film-75-ga-16w-x-3500l-clear-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 18:42:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sweeper-dry-43-wet-starter-kit-46handle-10-x-8-head-silvergreen-6carton>: HTTP status code is not handled or not allowed
2026-01-10 18:42:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/submersible-cast-iron-and-zinc-sump-pump-1-3-hp>: HTTP status code is not handled or not allowed
2026-01-10 18:42:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz-8945-universal-bump-cap-insert-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:42:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-pilaster-w-shoe-6w-x-82h-taupe>: HTTP status code is not handled or not allowed
2026-01-10 18:42:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ppok-087-measuring-pourer-7-8-oz>: HTTP status code is not handled or not allowed
2026-01-10 18:42:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-piece-steel-mesh-desk-organization-set-black>: HTTP status code is not handled or not allowed
2026-01-10 18:42:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/glass_cleaners> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/glass_cleaners landed on page that is not a product page.
2026-01-10 18:42:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ppok-113-measuring-pourer-1-1-8-oz>: HTTP status code is not handled or not allowed
2026-01-10 18:43:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500-hat-vented-4-point-fas-trac-iii-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:43:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-pilaster-w-shoe-12w-x-82h-khaki-brown>: HTTP status code is not handled or not allowed
2026-01-10 18:43:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v-gard-h2-mips-safety-helmet-vented-climbing-class-c-type-2-white>: HTTP status code is not handled or not allowed
2026-01-10 18:43:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mega-dipper-128-oz-green>: HTTP status code is not handled or not allowed
2026-01-10 18:43:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-with-keyway-2c-kw-series-climax-2c-037-kw>: HTTP status code is not handled or not allowed
2026-01-10 18:43:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-canvas-ce-phenolic-sheet-1-250-x-48-000-x-48-000>: HTTP status code is not handled or not allowed
2026-01-10 18:43:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-canvas-ce-phenolic-sheet-1-000-x-48-000-x-48-000>: HTTP status code is not handled or not allowed
2026-01-10 18:43:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brushless-drywall-cut-out-tool-kit-with-25ah-lithium-ion-batteries-24v>: HTTP status code is not handled or not allowed
2026-01-10 18:43:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9719 pages (at 92 pages/min), scraped 4120 items (at 37 items/min)
2026-01-10 18:43:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-industry-standard-clamping-couplings-climax-2iscc-075-050-s>: HTTP status code is not handled or not allowed
2026-01-10 18:43:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spjl-202-steam-pan-half-size-2-1-2h>: HTTP status code is not handled or not allowed
2026-01-10 18:43:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-fluid-level-sight-w-esg-glass-w-o-reflector-g-1-pipe-thread-r29-b>: HTTP status code is not handled or not allowed
2026-01-10 18:43:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-industry-standard-clamping-couplings-w-keyway-climax-2iscc-075-062kw>: HTTP status code is not handled or not allowed
2026-01-10 18:43:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patriot-fully-framed-ta-50-locker-wexpanded-metal-sides-42wx24dx78h-blall-welded>: HTTP status code is not handled or not allowed
2026-01-10 18:43:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patriot-fully-framed-ta-50-locker-wexpanded-metal-sides-48wx24dx78h-rdunassembled>: HTTP status code is not handled or not allowed
2026-01-10 18:43:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-x-14-x-10-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:43:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-fluid-level-sigh-w-esg-glass-w-reflector-g-3-4-pipe-thread-r25-a>: HTTP status code is not handled or not allowed
2026-01-10 18:43:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40-x-18-x-8-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:43:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o-201-general-purpose-polyolefin-cf-shrink-film-50-ga-22w-x-5250l-clear-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 18:43:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-5-all-stainless-pressure-gauge-1-4-npt-0-15000-psi-glycerine-filled-lm-301l-254v>: HTTP status code is not handled or not allowed
2026-01-10 18:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/packaging/stretch_wrap_shrink_wrap/shrink_wrap already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:43:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phenolic-black-core-pilaster-w-shoe-6w-x-82h-almond>: HTTP status code is not handled or not allowed
2026-01-10 18:43:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phenolic-black-core-outward-swing-partition-door-w-hardware-36w-graphite-grafix>: HTTP status code is not handled or not allowed
2026-01-10 18:43:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pmcd-14k-double-fold-menu-cover-8-1-2w-14h-plastic-w-vinyl-binding-double-page-black>: HTTP status code is not handled or not allowed
2026-01-10 18:43:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-climax-h2c-600>: HTTP status code is not handled or not allowed
2026-01-10 18:43:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patriot-fully-framed-ta-50-locker-wlouvered-doors-48wx24dx78h-blueall-welded>: HTTP status code is not handled or not allowed
2026-01-10 18:43:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ptmp-18r-round-potato-masher>: HTTP status code is not handled or not allowed
2026-01-10 18:43:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-climax-1c-131-z>: HTTP status code is not handled or not allowed
2026-01-10 18:43:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-pilaster-w-shoe-5w-x-82h-almond>: HTTP status code is not handled or not allowed
2026-01-10 18:43:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-oil-filled-cast-nylon-sheet-0-625-x-24-000-x-48-000>: HTTP status code is not handled or not allowed
2026-01-10 18:43:34 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/packaging/stretch_wrap_shrink_wrap/shrink_wrap> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/packaging/stretch_wrap_shrink_wrap/shrink_wrap landed on page that is not a product page.
2026-01-10 18:43:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vx-019-0167rp-14-inch-npt-inletoutlet-by-18-inch-npt-gauge-pressure-regulator>: HTTP status code is not handled or not allowed
2026-01-10 18:43:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-pilaster-w-shoe-4w-x-82h-navy-grafix>: HTTP status code is not handled or not allowed
2026-01-10 18:43:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-climax-2c-150>: HTTP status code is not handled or not allowed
2026-01-10 18:43:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vx-072-0001rp-tank-drain-valve-manual-wing-style>: HTTP status code is not handled or not allowed
2026-01-10 18:43:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4th-level-add-on-for-straight-transport-riser-gray-carpet-with-black-aluminum-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:43:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-trash-can-with-lift-handle-44-gal-cap-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:43:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-x-12-black-mailing-tubes-with-caps-case>: HTTP status code is not handled or not allowed
2026-01-10 18:43:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-two-piece-clamping-collar-climax-m2c-12-s>: HTTP status code is not handled or not allowed
2026-01-10 18:43:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mahr-federal-pocket-surf-probe>: HTTP status code is not handled or not allowed
2026-01-10 18:43:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qf-pipe-hanger-5-dia-galvanized-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:43:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wh-5-oil-and-vinegar-cruet-rack>: HTTP status code is not handled or not allowed
2026-01-10 18:43:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kwik-seal-ultra-5-5-oz-white-7079818914>: HTTP status code is not handled or not allowed
2026-01-10 18:43:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/banding-stretch-wrap-with-reusable-dispenser-cast-120-gauge-2w-x-700l-clear-pack-of-24>: HTTP status code is not handled or not allowed
2026-01-10 18:43:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qf-t-branch-6-6-6-6-dia-galvanized-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:43:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0030-07-shangarila-oyster-fork>: HTTP status code is not handled or not allowed
2026-01-10 18:43:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nova-tablet-arm-chair-without-storage-vinyl-seat-grayash-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:43:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qf-clamp-with-pin-14-dia-galvanized-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:43:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/afp-8s-fry-pan>: HTTP status code is not handled or not allowed
2026-01-10 18:43:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reborn-collection-convertible-crossbody-bag-polyester-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:43:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-footlocker-vented-18wx18dx76hblall-welded>: HTTP status code is not handled or not allowed
2026-01-10 18:43:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qf-butterfly-valve-6-dia-galvanized-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:43:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-couplings-recessed-screw-w-keyway-cc-series-climax-2cc-075-075-kw>: HTTP status code is not handled or not allowed
2026-01-10 18:43:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/everlast-task-chair-mid-back-no-tilt-21-31h-seat-black>: HTTP status code is not handled or not allowed
2026-01-10 18:43:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/132c-ice-logger-boot-regular-tan-9-5>: HTTP status code is not handled or not allowed
2026-01-10 18:43:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-24wx24dx72h-gray-all-welded>: HTTP status code is not handled or not allowed
2026-01-10 18:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coveralls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:44:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-two-piece-clamping-collar-climax-m2c-24>: HTTP status code is not handled or not allowed
2026-01-10 18:44:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-sided-bulk-truck-slat-sides-2-adj-shelves-3600-lbs-cap-30-60-poly-wheels>: HTTP status code is not handled or not allowed
2026-01-10 18:44:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sloped-handle-service-cart-lipped-shlfvs-1200-lbs-cap-18-32-5-poly-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:44:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-z4-comfort-side-padding-system>: HTTP status code is not handled or not allowed
2026-01-10 18:44:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-two-piece-clamping-collar-climax-m2c-30>: HTTP status code is not handled or not allowed
2026-01-10 18:44:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-poly-bag-rolls-36x48-4-mil-125-rl>: HTTP status code is not handled or not allowed
2026-01-10 18:44:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coil-cleaner-cleaner-for-ac-coils-fins-cherry-scent-gallon-4-case-nl294-g4>: HTTP status code is not handled or not allowed
2026-01-10 18:44:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0385r-iron-tuff-high-bib-overall-tall-navy-4xl>: HTTP status code is not handled or not allowed
2026-01-10 18:44:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coveralls>: HTTP status code is not handled or not allowed
2026-01-10 18:44:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9817 pages (at 98 pages/min), scraped 4163 items (at 43 items/min)
2026-01-10 18:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:44:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-vision-link-light-kit>: HTTP status code is not handled or not allowed
2026-01-10 18:44:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0385r-iron-tuff-high-bib-overall-regular-navy-5xl>: HTTP status code is not handled or not allowed
2026-01-10 18:44:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ccb-8r-bouillon-strainer-extra-fine-mesh-with-reinforcement>: HTTP status code is not handled or not allowed
2026-01-10 18:44:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-z-brite-wire-shelf-14x72>: HTTP status code is not handled or not allowed
2026-01-10 18:44:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelfsecurity-boxvented24wx18dx72hrdall-welded>: HTTP status code is not handled or not allowed
2026-01-10 18:44:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-footlocker-vented-24wx24dx76hgrall-welded>: HTTP status code is not handled or not allowed
2026-01-10 18:44:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0385r-iron-tuff-high-bib-overall-regular-navy-xl>: HTTP status code is not handled or not allowed
2026-01-10 18:44:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-footlocker-24wx21dx78h-gray-all-welded>: HTTP status code is not handled or not allowed
2026-01-10 18:44:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 18:44:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-gx4-strobe-light>: HTTP status code is not handled or not allowed
2026-01-10 18:44:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-day-capture-cartridges-for-terminator-replacement-carts-4pk-73891>: HTTP status code is not handled or not allowed
2026-01-10 18:44:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-2-2-non-flammable-gas-tagboard-placard>: HTTP status code is not handled or not allowed
2026-01-10 18:44:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0033-04-oxford-bouillon-spoon>: HTTP status code is not handled or not allowed
2026-01-10 18:44:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0381r-iron-tuff-minus-50-suit-regular-sage-4xl>: HTTP status code is not handled or not allowed
2026-01-10 18:44:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-one-piece-clamping-collar-climax-m1c-38>: HTTP status code is not handled or not allowed
2026-01-10 18:44:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-14-x-2-1-2-self-drilling-screw-phillips-pan-head-410-stainless-steel-ft-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:44:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0381r-iron-tuff-minus-50-suit-tall-sage-large>: HTTP status code is not handled or not allowed
2026-01-10 18:44:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-metered-air-care-refills-baby-powder-6-6-oz-can-12-cans-case-1042686>: HTTP status code is not handled or not allowed
2026-01-10 18:44:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bw-dl-deep-ladle>: HTTP status code is not handled or not allowed
2026-01-10 18:44:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bw-sl2-slotted-spoon>: HTTP status code is not handled or not allowed
2026-01-10 18:44:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0323-iron-tuff-womans-coat-regular-navy-small>: HTTP status code is not handled or not allowed
2026-01-10 18:44:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/azar-206320-clr-suggestion-box-11-w-x-8-1-4-d-x-52-3-4-h>: HTTP status code is not handled or not allowed
2026-01-10 18:44:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-z-link-comfort-pad>: HTTP status code is not handled or not allowed
2026-01-10 18:44:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pebble-surface-black-mat-4>: HTTP status code is not handled or not allowed
2026-01-10 18:44:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-bh-62-552-soft-face-sledge-hammer-95-lb-head-20l-steel-core-handle>: HTTP status code is not handled or not allowed
2026-01-10 18:44:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-inch-brass-interlocking-stencil-letters-and-numbers-forty-five-piece-set>: HTTP status code is not handled or not allowed
2026-01-10 18:44:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-inch-brass-interlocking-stencil-letters-thirty-three-piece-set>: HTTP status code is not handled or not allowed
2026-01-10 18:44:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lifting-oz2bca-mr-beam-clamp-2-ton-capacity-fits-beam-flange-9-10>: HTTP status code is not handled or not allowed
2026-01-10 18:44:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jlh-75wo-30-lever-hoist-with-overload-protection-34-ton-capacity-30-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/respiratory_protection/welding_face_masks_respirators already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:44:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-zlink-zytec-fr-shoulder-cape>: HTTP status code is not handled or not allowed
2026-01-10 18:44:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0525-cooler-wear-jacket-regular-navy-2xl>: HTTP status code is not handled or not allowed
2026-01-10 18:44:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jlh-300-15psh-lever-hoist-with-overload-protection-shipyard-hooks-3-ton-cap-15-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:44:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-cover-dividable-grid-container-sold-per-carton-2>: HTTP status code is not handled or not allowed
2026-01-10 18:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/first_aid_wound_treatment/emergency_blankets_bivouac_sacks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:44:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-schrader-mnpt-swivel-plug>: HTTP status code is not handled or not allowed
2026-01-10 18:44:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-inch-x-5-yards-self-adhesive-bandage-non-latex-dark-blue-pack-of-8>: HTTP status code is not handled or not allowed
2026-01-10 18:44:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-t200-tychem-2000-face-seal-hood>: HTTP status code is not handled or not allowed
2026-01-10 18:44:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maxicut-ultra-micro-foam-nitrile-coated-palm-fingers-gloves-ansi-a5-l-gray-6-dozencase>: HTTP status code is not handled or not allowed
2026-01-10 18:44:56 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/respiratory_protection/welding_face_masks_respirators> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/respiratory_protection/welding_face_masks_respirators landed on page that is not a product page.
2026-01-10 18:44:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-nova-3-hot-tube-xl-leather-cape>: HTTP status code is not handled or not allowed
2026-01-10 18:44:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-30-plastic-safety-edge-top-pedestal-workbench-w-3-drawers-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 18:44:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-212>: HTTP status code is not handled or not allowed
2026-01-10 18:44:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/surface-mounted-alarmed-cabinet-100bd-alarm-powder-coated-white>: HTTP status code is not handled or not allowed
2026-01-10 18:45:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-237-s>: HTTP status code is not handled or not allowed
2026-01-10 18:45:01 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/first_aid_wound_treatment/emergency_blankets_bivouac_sacks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/first_aid_wound_treatment/emergency_blankets_bivouac_sacks landed on page that is not a product page.
2026-01-10 18:45:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-inch-x-5-yards-self-adhesive-bandage-non-latex-black-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 18:45:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dxs2153-sae-deep-impact-socket-716-drive-black>: HTTP status code is not handled or not allowed
2026-01-10 18:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/surge_protectors_extension_cords/extension_cords already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:45:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-industry-standard-clamping-couplings-w-keyway-climax-iscc-125-125skw>: HTTP status code is not handled or not allowed
2026-01-10 18:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/surge_protectors_extension_cords/extension_cords already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:45:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glc-01021-pre-cleaned-clean-glass-screw-thread-sample-vials-10-dram-40ml-case-of-72>: HTTP status code is not handled or not allowed
2026-01-10 18:45:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-949evs-milling-machine-with-acu-rite-203-dro-x-y-z-axis-powerfeeds-3-hp-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:45:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1022-8-micro-filter-metal-bowl-12-npt-250-psi-40-micron>: HTTP status code is not handled or not allowed
2026-01-10 18:45:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/636-deluxe-in-line-lubricator-14-npt-150-psi>: HTTP status code is not handled or not allowed
2026-01-10 18:45:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 9908 pages (at 91 pages/min), scraped 4203 items (at 40 items/min)
2026-01-10 18:45:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-x-5-yards-self-adhesive-bandage-non-latex-black>: HTTP status code is not handled or not allowed
2026-01-10 18:45:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-threaded-clamping-collar-climax-istc-125-12>: HTTP status code is not handled or not allowed
2026-01-10 18:45:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1450110-airflow-conveyor-chain-ps-8e-40012>: HTTP status code is not handled or not allowed
2026-01-10 18:45:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1450150-airflow-conveyor-chain-af-24d-60065>: HTTP status code is not handled or not allowed
2026-01-10 18:45:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/surge_protectors_extension_cords/extension_cords> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/surge_protectors_extension_cords/extension_cords landed on page that is not a product page.
2026-01-10 18:45:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/surge_protectors_extension_cords/extension_cords>: HTTP status code is not handled or not allowed
2026-01-10 18:45:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/imperial-shelving-starter-36x12x88-7-openings-sand>: HTTP status code is not handled or not allowed
2026-01-10 18:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/replacement_shelves_decks/file_additional_shelves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:45:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-1236vs-elite-evs-lathe-with-newall-dp700-dro-taper-attachment-2-hp-3ph-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:45:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-locker-double-tier-12x12x36-without-legs-2-doors-assembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:45:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jdp-20vs-3-variable-speed-drill-press-2-hp-3-phase-230460v>: HTTP status code is not handled or not allowed
2026-01-10 18:45:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-bp-9078cnc-78-hydraulic-press-brake-with-delem-cnc-control-3ph-220v>: HTTP status code is not handled or not allowed
2026-01-10 18:45:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-round-platter-led-flush-mount-light-30w-120v-3000k-white>: HTTP status code is not handled or not allowed
2026-01-10 18:45:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-double-wide-climax-d2c-037-a>: HTTP status code is not handled or not allowed
2026-01-10 18:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:45:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1304729-boss-hose-hyd09922>: HTTP status code is not handled or not allowed
2026-01-10 18:45:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c151r-osha-sign-caution-eye-ear-protection-required-in-this-area-7-x-10-yellowblack>: HTTP status code is not handled or not allowed
2026-01-10 18:45:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/shelving/replacement_shelves_decks/file_additional_shelves>: HTTP status code is not handled or not allowed
2026-01-10 18:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:45:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips>: HTTP status code is not handled or not allowed
2026-01-10 18:45:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d217pb-osha-sign-danger-no-smoking-matches-or-open-flames-10-x-14-whiteredblack>: HTTP status code is not handled or not allowed
2026-01-10 18:45:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-3-tier-wire-shelving-add-on-unit-42-w-x-21-d-x-34-h>: HTTP status code is not handled or not allowed
2026-01-10 18:45:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-with-high-temp-adhesive-50a-316-thick-x-36-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:45:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1308005-meyer-blade-guide-09916>: HTTP status code is not handled or not allowed
2026-01-10 18:45:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1304712-boss-shoe-assy-msc01570>: HTTP status code is not handled or not allowed
2026-01-10 18:45:34 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets landed on page that is not a product page.
2026-01-10 18:45:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-parking-curb-with-hardware-72-l-x-4-h-x-6-w>: HTTP status code is not handled or not allowed
2026-01-10 18:45:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ibc-containment-unit>: HTTP status code is not handled or not allowed
2026-01-10 18:45:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls>: HTTP status code is not handled or not allowed
2026-01-10 18:45:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-series-spring-rewind-hose-reel-for-air-water-3-8-i-d-100-hose-300-psi>: HTTP status code is not handled or not allowed
2026-01-10 18:45:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/75-ton-hydraulic-ironworker-w-powerlink-4-tooling-stations-3ph-460-v>: HTTP status code is not handled or not allowed
2026-01-10 18:45:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-series-spring-rewind-hose-reel-for-air-water-3-8-i-d-25-hose-300-psi>: HTTP status code is not handled or not allowed
2026-01-10 18:45:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-threaded-clamping-collar-climax-istc-043-14-s>: HTTP status code is not handled or not allowed
2026-01-10 18:45:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-replacement-liner-8-bushel-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:45:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mesh-back-task-chair-fabric-seat-chrome-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:45:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-replacement-liner-18-bushel-red-2>: HTTP status code is not handled or not allowed
2026-01-10 18:45:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-industry-standard-clamping-couplings-climax-iscc-087-062>: HTTP status code is not handled or not allowed
2026-01-10 18:45:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-industry-standard-clamping-couplings-w-keyway-climax-iscc-087-087skw>: HTTP status code is not handled or not allowed
2026-01-10 18:45:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-rewind-static-discharge-hand-crank-cable-reel-200-cable>: HTTP status code is not handled or not allowed
2026-01-10 18:45:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hac-142-deep-cake-pan>: HTTP status code is not handled or not allowed
2026-01-10 18:45:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fb-40-heavy-duty-fry-basket-rectangle-yellow-plastic>: HTTP status code is not handled or not allowed
2026-01-10 18:45:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fiberglass-tote-box-20-1-2x12-7-8x8-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:45:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-8-wheel-kit-with-axle-and-hardware-includes-2-8-wheels-1-1-2-diameter-axle-2-1-2-washers-2-1-2-pushnuts-and-2-axle-spacers>: HTTP status code is not handled or not allowed
2026-01-10 18:45:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/composition-notebook-college-ruled-black-marble-12-set>: HTTP status code is not handled or not allowed
2026-01-10 18:45:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0001-05-dominion-dinner-fork>: HTTP status code is not handled or not allowed
2026-01-10 18:45:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-neoteq-caster-with-grip-ring-swivel-stem-1-7-16h-stem-175-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:45:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/back-gauge-for-48-40t-ironworker>: HTTP status code is not handled or not allowed
2026-01-10 18:45:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50180-az-x-fiber-disc-4-1-2-inch-x-7-8-inch-36-grit-zirconium>: HTTP status code is not handled or not allowed
2026-01-10 18:46:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-strip-with-acrylic-adhesive-60a-12-thick-x-6-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:46:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-recessed-screw-climax-h1c-150>: HTTP status code is not handled or not allowed
2026-01-10 18:46:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-with-acrylic-adhesive-50a-18-thick-x-36-w-x-10-ft-l>: HTTP status code is not handled or not allowed
2026-01-10 18:46:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-compartment-kids-hanging-toy-sorter-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:46:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50117-2a-fiber-disc-4-1-2-inch-x-7-8-inch-50-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 18:46:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-one-piece-clamping-collar-climax-m1c-04-s>: HTTP status code is not handled or not allowed
2026-01-10 18:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/respiratory_protection/disposable_face_masks_respirators already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:46:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/84915-da-f-sanding-sheets-9-inch-x-11-inch-daf-180-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 18:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/outdoor_furniture/outdoor_seating/bleachers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:46:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-143-a>: HTTP status code is not handled or not allowed
2026-01-10 18:46:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10001 pages (at 93 pages/min), scraped 4242 items (at 39 items/min)
2026-01-10 18:46:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/confectionary-scoop>: HTTP status code is not handled or not allowed
2026-01-10 18:46:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/economy-d-ring-vinyl-view-binder-3-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 18:46:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-sheet-with-acrylic-adhesive-50a-38-thick-x-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 18:46:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pebble-surface-mat-black-yellow-48-es-wide>: HTTP status code is not handled or not allowed
2026-01-10 18:46:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-4320-latch-kit-new-style-7-1-2t-carbon-11t-alloy-hook-3-56-l-x-1-25-w>: HTTP status code is not handled or not allowed
2026-01-10 18:46:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls landed on page that is not a product page.
2026-01-10 18:46:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/din-508-t-slot-nuts-steel-blackened-m12-1-w-x-11-16-h>: HTTP status code is not handled or not allowed
2026-01-10 18:46:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/respiratory_protection/disposable_face_masks_respirators>: HTTP status code is not handled or not allowed
2026-01-10 18:46:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/outdoor_furniture/outdoor_seating/bleachers>: HTTP status code is not handled or not allowed
2026-01-10 18:46:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-187-bo>: HTTP status code is not handled or not allowed
2026-01-10 18:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/binders_covers/binders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:46:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-step-24-w-grip-safety-angle-ladder>: HTTP status code is not handled or not allowed
2026-01-10 18:46:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-293-dt>: HTTP status code is not handled or not allowed
2026-01-10 18:46:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-with-wire-decking-72x18x72-starter>: HTTP status code is not handled or not allowed
2026-01-10 18:46:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gd-52121-t-latching-handle-non-locking-516-shaft>: HTTP status code is not handled or not allowed
2026-01-10 18:46:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tn-400-abrasive-belt-notcher-34-2-od-3-hp-1-phase-220v>: HTTP status code is not handled or not allowed
2026-01-10 18:46:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fo-603-tip-out-bin-carts-3-drawers-40-lb-cap-6-516l-x-23-1116w-x-9-78h-white>: HTTP status code is not handled or not allowed
2026-01-10 18:46:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cortech-usa-tpdbb-high-security-double-blank-cover-plate-w-hardware1-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:46:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sheet-metal-shear-7-5-hp-3-phase-220v-sh-12010>: HTTP status code is not handled or not allowed
2026-01-10 18:46:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-6067-shower-door-international-bottom-guide>: HTTP status code is not handled or not allowed
2026-01-10 18:46:30 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/binders_covers/binders> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/binders_covers/binders landed on page that is not a product page.
2026-01-10 18:46:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leeson-single-phase-general-purpose-motor-50hz-1-2hp-37kw-1425rpm-56h-ip22-resilient-base>: HTTP status code is not handled or not allowed
2026-01-10 18:46:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-70a-316-thick-x-36-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:46:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-rubber-sheet-no-adhesive-75a-116-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 18:46:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-speed-electric-tarp-gear-motor-5541065>: HTTP status code is not handled or not allowed
2026-01-10 18:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=sheet-metal-notcher-4-hp-3-phase-220v-sn-f04-ms already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:46:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sheet-metal-corner-notcher-3-hp-3-phase-220v-sn-f09-ms>: HTTP status code is not handled or not allowed
2026-01-10 18:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:46:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-lid-114004>: HTTP status code is not handled or not allowed
2026-01-10 18:46:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets>: HTTP status code is not handled or not allowed
2026-01-10 18:46:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silver-handle-otg>: HTTP status code is not handled or not allowed
2026-01-10 18:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=heavy-duty-metal-dust-collector-110v-single-phase-1-5-hp-mdc-1200-hd already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:46:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-purpose-manual-sheet-metal-shear-14-gauge-mild-steel-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:46:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/return-shell-reversible-30w-x-24d-x-29-1-2h-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 18:46:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls landed on page that is not a product page.
2026-01-10 18:46:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-slip-roll-24-width-20-gauge-mild-steel-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:46:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pem-aluminum-saddle-threshold-72-l-x-6-w-1-2-h-mill-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:46:45 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=sheet-metal-notcher-4-hp-3-phase-220v-sn-f04-ms> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=sheet-metal-notcher-4-hp-3-phase-220v-sn-f04-ms landed on page that is not a product page.
2026-01-10 18:46:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-60a-38-thick-x-36-wide-x-4-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:46:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pem-aluminum-saddle-threshold-36-l-x-6-w-1-4-h-mill-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:46:46 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets landed on page that is not a product page.
2026-01-10 18:46:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/basic-medium-moving-boxes-18l-x-15w-x-14h-kraft-blue-8-ctn>: HTTP status code is not handled or not allowed
2026-01-10 18:46:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-general-security-laminated-padlocks-no-2kab>: HTTP status code is not handled or not allowed
2026-01-10 18:46:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-strength-hand-truck-loop-handle-8-x-250-solid-rubber-tire>: HTTP status code is not handled or not allowed
2026-01-10 18:46:49 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=heavy-duty-metal-dust-collector-110v-single-phase-1-5-hp-mdc-1200-hd> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=heavy-duty-metal-dust-collector-110v-single-phase-1-5-hp-mdc-1200-hd landed on page that is not a product page.
2026-01-10 18:46:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rapidroll-centre-shaft-and-crank-handle-assembly-70-7001>: HTTP status code is not handled or not allowed
2026-01-10 18:46:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/311-carton-sealing-tape-3-x-110-yds-205-mil-clear-24pack>: HTTP status code is not handled or not allowed
2026-01-10 18:46:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-60a-132-thick-x-36-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:46:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patio-heater-with-remote-control-glass-cover-natural-gas-propane-37000-btu-120v>: HTTP status code is not handled or not allowed
2026-01-10 18:46:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m18-redlithium-high-output-cp3-0-starter-kit>: HTTP status code is not handled or not allowed
2026-01-10 18:46:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gre-840ah-hand-bender-w-handle-12>: HTTP status code is not handled or not allowed
2026-01-10 18:46:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smi6-general-purpose-laboratory-incubator-5-7-cu-ft-162-l-115v>: HTTP status code is not handled or not allowed
2026-01-10 18:46:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-70a-38-thick-x-36-wide-x-6-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:46:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smi12-general-purpose-laboratory-incubator-dual-stacked-11-4-cu-ft-324-l-115v>: HTTP status code is not handled or not allowed
2026-01-10 18:46:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/291-acrylic-carton-sealing-tape-3-x-110-yds-26-mil-tan-6pack>: HTTP status code is not handled or not allowed
2026-01-10 18:46:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/decorative-grid-kit-for-hs45gsp-high-intensity-heaters>: HTTP status code is not handled or not allowed
2026-01-10 18:46:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swbc22-digital-circulating-water-bath-22-liter-capacity-115v>: HTTP status code is not handled or not allowed
2026-01-10 18:47:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-60a-316-thick-x-36-wide-x-9-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:47:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-part-stub-style-inventory-tag-pre-wired-3000-3999-8-6-14l-x-3-18w-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:47:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carton-sealing-tape-if-seal-has-been-3-x-110-yds-bluewhite-6pack>: HTTP status code is not handled or not allowed
2026-01-10 18:47:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vpkq130-circuit-breaker-type-qp-1-pole-30a-clamshell-packaged>: HTTP status code is not handled or not allowed
2026-01-10 18:47:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-rubber-sheet-with-high-temp-adhesive-75a-116-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 18:47:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ubia250ni-circuit-breaker-type-a-2-pole-50a>: HTTP status code is not handled or not allowed
2026-01-10 18:47:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flush-handle-instrument-cart-lip-shelves-30-x-48>: HTTP status code is not handled or not allowed
2026-01-10 18:47:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-general-security-laminated-padlocks-no-443ka>: HTTP status code is not handled or not allowed
2026-01-10 18:47:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vpkd230-circuit-breaker-type-qd-replacement-for-square-d-qo-2-pole-30a-clamshell-pkg>: HTTP status code is not handled or not allowed
2026-01-10 18:47:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vpkubif0235n-circuit-breaker-type-ubif-thin-2-pole-35a-clamshell-packaged>: HTTP status code is not handled or not allowed
2026-01-10 18:47:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/56-quart-lockable-storage-trunk-24-inch-l-x-15-inch-w-x-13-inch-h-od-green>: HTTP status code is not handled or not allowed
2026-01-10 18:47:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10092 pages (at 91 pages/min), scraped 4270 items (at 28 items/min)
2026-01-10 18:47:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/13lf100x1-2-steel-black-oxide-13-tooth-1-552-pitch-finished-bore-pulley>: HTTP status code is not handled or not allowed
2026-01-10 18:47:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1400-rubber-10-work-overshoes-black-cleated-outsole-xl>: HTTP status code is not handled or not allowed
2026-01-10 18:47:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-general-security-weather-resistant-covered-laminated-padlocks-no-312>: HTTP status code is not handled or not allowed
2026-01-10 18:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:47:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j26112-bomber-ii-hooded-jacket-fluorescent-yellowgreenblack-sm>: HTTP status code is not handled or not allowed
2026-01-10 18:47:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insulated-replacement-cover-rubber-white-for-n1w-n1aw-n1ssw>: HTTP status code is not handled or not allowed
2026-01-10 18:47:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-industrial-spray-nozzle-safety-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:47:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-shelving-closed-shelving-36x12x39-9>: HTTP status code is not handled or not allowed
2026-01-10 18:47:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j26119-bomber-ii-hooded-jacket-fluorescent-orangeredblack-lg>: HTTP status code is not handled or not allowed
2026-01-10 18:47:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modine-high-efficiency-150000-btu-gas-fired-unit-heater>: HTTP status code is not handled or not allowed
2026-01-10 18:47:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-with-acrylic-adhesive-50a-332-thick-x-36-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:47:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hytrol-5-ft-24-inch-w-1-9-inch-dia-galvanized-rollers-21-inch-between-rail-3-inch-rollers-centers>: HTTP status code is not handled or not allowed
2026-01-10 18:47:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls>: HTTP status code is not handled or not allowed
2026-01-10 18:47:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-locker-single-tier-12x12x60-1-door-assembled-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:47:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-locker-single-tier-12x18x60-3-door-assembled-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:47:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-low-circular-profile-square-nose-125-x-72-lunar-dust>: HTTP status code is not handled or not allowed
2026-01-10 18:47:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/373-carton-sealing-tape-2-x-55-yds-25-mil-tan-6pack>: HTTP status code is not handled or not allowed
2026-01-10 18:47:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluidity-02f-direct-acting-solenoid-valve-3-2-nc-fkm-seal-1-4-nptf-2-mm-12v-dc>: HTTP status code is not handled or not allowed
2026-01-10 18:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:47:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-boxes-18l-x-14w-x-12h-kraft-20pack>: HTTP status code is not handled or not allowed
2026-01-10 18:47:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-ketron-peek-sheet-q-1-250-thick-x-24-w-x-24-l>: HTTP status code is not handled or not allowed
2026-01-10 18:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:47:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-heavy-duty-ribbed-stair-tread-square-nose-125-x-48-pewter>: HTTP status code is not handled or not allowed
2026-01-10 18:47:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colored-carton-sealing-tape-3-x-55-yds-22-mil-orange-6pack>: HTTP status code is not handled or not allowed
2026-01-10 18:47:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-430-nipple-5-8-hose-barb-industrial-interchange-3-8>: HTTP status code is not handled or not allowed
2026-01-10 18:47:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-315-coupling-1-2-hose-barb-asian-interchange>: HTTP status code is not handled or not allowed
2026-01-10 18:47:36 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_strips landed on page that is not a product page.
2026-01-10 18:47:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-ertalyte-pet-p-rod-q-0-25-dia>: HTTP status code is not handled or not allowed
2026-01-10 18:47:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-no-adhesive-40a-14-thick-x-36-wide-x-8-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:47:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-delrin-homopolymer-sheet-3-000-thick-x-24-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 18:47:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merit-red-brass-seamless-standard-14-Close-npt-male>: HTTP status code is not handled or not allowed
2026-01-10 18:47:40 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls landed on page that is not a product page.
2026-01-10 18:47:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digital-portion-scale-7-pound-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:47:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls>: HTTP status code is not handled or not allowed
2026-01-10 18:47:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/string--button-file-storage-boxes-24l-x-15w-x-10-12h-white-12pack>: HTTP status code is not handled or not allowed
2026-01-10 18:47:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-delrin-homopolymer-sheet-2-000-thick-x-24-w-x-24-l>: HTTP status code is not handled or not allowed
2026-01-10 18:47:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hiland-fire-pit-waterproof-cover-hvd-rfp-cvr-tan-37l-x-29w-x-22h-fits-gsf-rfp>: HTTP status code is not handled or not allowed
2026-01-10 18:47:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-sheet-with-high-temp-adhesive-50a-38-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 18:47:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-delrin-homopolymer-sheet-0-500-thick-x-24-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 18:47:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelving-36x12x60-gray-with-4-shelves-1500-lb-cap-per-shelf>: HTTP status code is not handled or not allowed
2026-01-10 18:47:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-in-super-air-knife-only-303ss>: HTTP status code is not handled or not allowed
2026-01-10 18:47:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-delrin-homopolymer-rod-0-500-dia>: HTTP status code is not handled or not allowed
2026-01-10 18:47:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-no-adhesive-40a-18-thick-x-36-wide-x-6-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 18:47:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medium-vortex-tube-15-scfm-1000-btu-hr>: HTTP status code is not handled or not allowed
2026-01-10 18:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/abrasives/general_purpose_sanding/hand_sanding_pads_holders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:47:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-1-2x7-8-z3-36-t27-reg100-za-flap-disc>: HTTP status code is not handled or not allowed
2026-01-10 18:47:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-sheet-no-adhesive-50a-12-thick-x-36-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 18:47:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cold-muffler-for-10-40-scfm-vortex-tube>: HTTP status code is not handled or not allowed
2026-01-10 18:47:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/physicianscare-first-aid-plastic-bandages>: HTTP status code is not handled or not allowed
2026-01-10 18:47:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v41108-safetyflex-zipper-fly-front-hooded-coverall-lg>: HTTP status code is not handled or not allowed
2026-01-10 18:48:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-x7-8-z3-40-t27-xl100-za-flap-disc>: HTTP status code is not handled or not allowed
2026-01-10 18:48:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-delrin-homopolymer-sheet-2-000-thick-x-12-w-x-12-l>: HTTP status code is not handled or not allowed
2026-01-10 18:48:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slatwall-cherry-shelves-3-4-x8-x22-1-2-finished-on-2-sides-and-3-edges>: HTTP status code is not handled or not allowed
2026-01-10 18:48:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/abrasives/general_purpose_sanding/hand_sanding_pads_holders>: HTTP status code is not handled or not allowed
2026-01-10 18:48:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-round-outdoor-counter-height-table-36-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:48:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-174-36-round-steel-mesh-outdoor-bar-table-black>: HTTP status code is not handled or not allowed
2026-01-10 18:48:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j53107-35mm-industrial-work-hooded-jacket-yellow-xl>: HTTP status code is not handled or not allowed
2026-01-10 18:48:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-shaped-electric-height-adjustable-desk-60-w-24-d-mahogany-w-black-base>: HTTP status code is not handled or not allowed
2026-01-10 18:48:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10185 pages (at 93 pages/min), scraped 4309 items (at 39 items/min)
2026-01-10 18:48:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-shaped-electric-height-adjustable-desk-72-w-24-d-gray-w-gray-base>: HTTP status code is not handled or not allowed
2026-01-10 18:48:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grease-system-400-lb>: HTTP status code is not handled or not allowed
2026-01-10 18:48:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/63xl-high-yield-tri-color-original-ink-cartridge-330-page-yield>: HTTP status code is not handled or not allowed
2026-01-10 18:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/abrasives/sanding_discs/flap_sanding_discs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:48:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j53122-comfortbrite-jacket-fluorescent-lime-4xl>: HTTP status code is not handled or not allowed
2026-01-10 18:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/abrasives/sanding_discs/flap_sanding_discs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:48:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tygon-b44-4x-tube-aaa00053-0-750-id-x-1-000-od-x-50-l>: HTTP status code is not handled or not allowed
2026-01-10 18:48:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perm-liner-truck-20-bu-red-vinyl-wire-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 18:48:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls landed on page that is not a product page.
2026-01-10 18:48:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/expandable-starter-rack-48x18x84-gray-with-3-level-wood-deck-1500lb-cap-per-deck>: HTTP status code is not handled or not allowed
2026-01-10 18:48:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-oil-filled-cast-nylon-tube-6-id-x-8-od-x-13-l>: HTTP status code is not handled or not allowed
2026-01-10 18:48:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-part-stub-style-inventory-tag-7000-7999-8-6-14l-x-3-18w-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:48:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/508x-high-yield-cyan-original-laserjet-toner-cartridge-9500-page-yield>: HTTP status code is not handled or not allowed
2026-01-10 18:48:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-s-b-6-8amed-whl048011-13616>: HTTP status code is not handled or not allowed
2026-01-10 18:48:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/abrasives/sanding_discs/flap_sanding_discs>: HTTP status code is not handled or not allowed
2026-01-10 18:48:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/abrasives/sanding_discs/flap_sanding_discs>: HTTP status code is not handled or not allowed
2026-01-10 18:48:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-rack-wood-deck-starter-4-level-gray-7>: HTTP status code is not handled or not allowed
2026-01-10 18:48:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylatron-gs-sheet-extruded-0-750-thick-x-24-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 18:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/abrasives/grinding_cutoff_wheels/surface_grinding_wheels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:48:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-oil-filled-cast-nylon-rod-5-dia>: HTTP status code is not handled or not allowed
2026-01-10 18:48:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/expandable-add-on-rack-48x12x84-gray-with-3-levels-no-deck-1500-lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 18:48:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylatron-gsm-sheet-cast-2-500-thick-x-24-w-x-24-l>: HTTP status code is not handled or not allowed
2026-01-10 18:48:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-heavy-duty-600-lb-cap-safety-angle-steel-rolling-ladder-perfor>: HTTP status code is not handled or not allowed
2026-01-10 18:48:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-workbench-butcher-block-top-fixed-height-24-x-48>: HTTP status code is not handled or not allowed
2026-01-10 18:48:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heatstar-hs250ag-commercial-greenhouse-heater-propane-natural-gas-dual-fuel-250000-btu-120v>: HTTP status code is not handled or not allowed
2026-01-10 18:48:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gorbel-hd-wall-bracket-jib-crane-20-ft-span-and-200and-176-rotation-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:48:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-30-glass-filled-nylon-6-6-sheet-0-750-thick-x-48-w-x-96-l>: HTTP status code is not handled or not allowed
2026-01-10 18:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/abrasives/grinding_cutoff_wheels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:48:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/del-round-brush-d>: HTTP status code is not handled or not allowed
2026-01-10 18:48:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gorbel-hd-free-standing-jib-crane-12-ft-span-and-16-ft-height-under-boom-10000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:48:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pedestal-stroller-for-high-velocity-dock-fans>: HTTP status code is not handled or not allowed
2026-01-10 18:48:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-cas-761-durostone-sheet-0-472-thick-x-48-000-w-x-96-000-l>: HTTP status code is not handled or not allowed
2026-01-10 18:48:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-bin-for-cubby-lockers-10-1-8-w-x-13-3-4-d-x-2-1-4-h>: HTTP status code is not handled or not allowed
2026-01-10 18:48:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-gift-box-lids-4l-x-4w-white-50pack>: HTTP status code is not handled or not allowed
2026-01-10 18:48:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proform-f3-h013005-standard-harness-quick-connect-legs-xxl>: HTTP status code is not handled or not allowed
2026-01-10 18:48:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-one-heavy-duty-industrial-cleaner-55-gallon-drum>: HTTP status code is not handled or not allowed
2026-01-10 18:48:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fury-heavy-duty-non-corrosive-autoscrubber-degreaser-unscented-gal-4-bottles-910593>: HTTP status code is not handled or not allowed
2026-01-10 18:48:47 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/abrasives/grinding_cutoff_wheels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/abrasives/grinding_cutoff_wheels landed on page that is not a product page.
2026-01-10 18:48:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reverse-tuck-folding-cartons-4l-x-1-58w-x-4h-white-500pack>: HTTP status code is not handled or not allowed
2026-01-10 18:48:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-sided-16-rail-unit-with-16-qus220-18-qus230-12-qus240-ultra-stack-hang-bins-black>: HTTP status code is not handled or not allowed
2026-01-10 18:48:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/retainer-lip-60-x-4-9706-3-02>: HTTP status code is not handled or not allowed
2026-01-10 18:48:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/x-floating-degreaser-for-lift-stations-5-gallon-pail>: HTTP status code is not handled or not allowed
2026-01-10 18:48:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-gpo-3-sheet-0-500-thick-x-48-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 18:48:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-54-w-x-18-d-x-63-h>: HTTP status code is not handled or not allowed
2026-01-10 18:48:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-wire-shelf-truck-72x18x69-1200-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:48:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eva-tubing-shrink-wrapped-coil-w-label-3-4-i-d-x-1-8-wall-25-feet>: HTTP status code is not handled or not allowed
2026-01-10 18:48:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eva-tubing-w-nylon-braid-reinforcement-bulk-1-4-i-d-300-feet>: HTTP status code is not handled or not allowed
2026-01-10 18:48:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eva-tubing-w-nylon-braid-reinforcement-bulk-3-8-i-d-300-feet>: HTTP status code is not handled or not allowed
2026-01-10 18:48:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aspect-subway-matted-12-x-4-brushed-stainless-metal-decorative-tile-backsplash-a95-50>: HTTP status code is not handled or not allowed
2026-01-10 18:48:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-storage-locker-30-x-48>: HTTP status code is not handled or not allowed
2026-01-10 18:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/walls_ceilings/ceiling_tiles already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:48:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2460-flatback-tape-2-x-60-yds-33-mil-gold-12pack>: HTTP status code is not handled or not allowed
2026-01-10 18:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/plumbing/hoses_tubes/commercial_industrial_tubing already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:48:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-folding-security-gate-10-x-5>: HTTP status code is not handled or not allowed
2026-01-10 18:49:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alkaline-cleaner-and-degreaser-gallon-bottle-4-bottles>: HTTP status code is not handled or not allowed
2026-01-10 18:49:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gift-boxes-3l-x-3w-x-3h-kraft-100pack>: HTTP status code is not handled or not allowed
2026-01-10 18:49:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-top-machine-table-18-x-24-x-36-swivel-casters-w-brakes>: HTTP status code is not handled or not allowed
2026-01-10 18:49:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/great-lakes-tin-jamestown-2-x-2-nail-up-tin-ceiling-tile-in-copper-t51-08>: HTTP status code is not handled or not allowed
2026-01-10 18:49:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-storage-locker-24-x-60>: HTTP status code is not handled or not allowed
2026-01-10 18:49:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gift-boxes-5l-x-5w-x-3h-kraft-100pack>: HTTP status code is not handled or not allowed
2026-01-10 18:49:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machinery-guard-round-48x48>: HTTP status code is not handled or not allowed
2026-01-10 18:49:07 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-supplies/walls_ceilings/ceiling_tiles> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-supplies/walls_ceilings/ceiling_tiles landed on page that is not a product page.
2026-01-10 18:49:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/plumbing/hoses_tubes/commercial_industrial_tubing>: HTTP status code is not handled or not allowed
2026-01-10 18:49:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/great-lakes-tin-rochester-2-x-2-nail-up-tin-ceiling-tile-in-clear-t58-04>: HTTP status code is not handled or not allowed
2026-01-10 18:49:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10279 pages (at 94 pages/min), scraped 4345 items (at 36 items/min)
2026-01-10 18:49:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g2-116t-ap-3hp-oil-injected-rotary-screw-71-gallon-tank-mount-116psi-1ph-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:49:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-wire-shelving-72wx14dx54h>: HTTP status code is not handled or not allowed
2026-01-10 18:49:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/products-crossover-truck-box-27x71x23-matte-black>: HTTP status code is not handled or not allowed
2026-01-10 18:49:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fresh-products-easy-fresh-dispenser-white-12-dispensers-case>: HTTP status code is not handled or not allowed
2026-01-10 18:49:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gourmet-digital-thermometer-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/wire_shelving/poly_zbrite_wire_shelves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:49:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acrylic-carton-sealing-tape-4-x-72-yds-2-mil-clear-18pack>: HTTP status code is not handled or not allowed
2026-01-10 18:49:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-oil-5000-cst-4-oz-bottle-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:49:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/libman-commercial-18-inch-smooth-sweep-complete-set>: HTTP status code is not handled or not allowed
2026-01-10 18:49:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/synthetic-extra-lightweight-oil-4-oz-bottle-iso-46-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:49:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toilet-seat-cover-dispenser-17-25-w-x-3-13-d-x-11-75-h-smoke-black>: HTTP status code is not handled or not allowed
2026-01-10 18:49:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/health-gards-toilet-seat-cover-dispenser-half-fold-16-w-x-3-25-d-x-11-5-h-smoke>: HTTP status code is not handled or not allowed
2026-01-10 18:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_supplies_dispensers/toilet_seat_covers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:49:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reverse-tuck-folding-cartons-3l-x-1-516w-x-3h-kraft-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:49:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7020m-sliding-nut-5512705>: HTTP status code is not handled or not allowed
2026-01-10 18:49:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/shelving/wire_shelving/poly_zbrite_wire_shelves>: HTTP status code is not handled or not allowed
2026-01-10 18:49:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magnum-300-welding-gun-035-045-liner-15l-cable>: HTTP status code is not handled or not allowed
2026-01-10 18:49:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultrasonic-table-top-parts-cleaning-system-digital-timer-heat-power-control-7-gal-45-khz-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:49:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultrasonic-table-top-parts-cleaning-system-digital-timer-heat-power-control-1-5-gal-45-khz-115v>: HTTP status code is not handled or not allowed
2026-01-10 18:49:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bntc1224-12-x-24-exposed-flange-cam-latch>: HTTP status code is not handled or not allowed
2026-01-10 18:49:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/collomix-mk160hf-heavy-duty-3-blade-paddle-large-batch>: HTTP status code is not handled or not allowed
2026-01-10 18:49:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/restroom_supplies_dispensers/toilet_seat_covers>: HTTP status code is not handled or not allowed
2026-01-10 18:49:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bxtl2424-24-x-24-exposed-flange-locking-handle>: HTTP status code is not handled or not allowed
2026-01-10 18:49:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bloodborne-pathogens-protection-kit>: HTTP status code is not handled or not allowed
2026-01-10 18:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/cookware_bakeware/pots_pans/frying_pans_skillets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:49:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-kit-60-w-workbench-with-18-w-36-w-pegboards-mounting-rail-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:49:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-16-w-3-step-steel-rolling-ladder-21-d-top-step>: HTTP status code is not handled or not allowed
2026-01-10 18:49:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-kit-72-w-workbench-with-18-w-36-w-whiteboard-mounting-rail-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:49:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-bin-and-shelf-cart-w-two-louvered-panel-putty>: HTTP status code is not handled or not allowed
2026-01-10 18:49:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/y-connection-with-valve>: HTTP status code is not handled or not allowed
2026-01-10 18:49:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-purpose-cleaner-morning-meadow-23-oz-trigger-spray-bottle-8-case>: HTTP status code is not handled or not allowed
2026-01-10 18:49:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bitk1616-16-x-16-exposed-flange-knurled-knob>: HTTP status code is not handled or not allowed
2026-01-10 18:49:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lf-74-heavy-duty-wire-feeder-bench-model-24-42-vac>: HTTP status code is not handled or not allowed
2026-01-10 18:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/dunnage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:49:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/foodservice/cookware_bakeware/pots_pans/frying_pans_skillets>: HTTP status code is not handled or not allowed
2026-01-10 18:49:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-security-cross-cut-paper-shredder-with-auto-oiling-system>: HTTP status code is not handled or not allowed
2026-01-10 18:49:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-comfort-construction-style-positioning-climbing-harness-1140188-m>: HTTP status code is not handled or not allowed
2026-01-10 18:49:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-intermediate-lubricator>: HTTP status code is not handled or not allowed
2026-01-10 18:49:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/embassy-36-system6-heater-020-fins>: HTTP status code is not handled or not allowed
2026-01-10 18:49:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keyguard-coverall-elastic-wrists-ankles-attached-hood-zipper-front-white-xl-25cs>: HTTP status code is not handled or not allowed
2026-01-10 18:49:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2221vs-key-5510093>: HTTP status code is not handled or not allowed
2026-01-10 18:49:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2232ac-seal-oil-5510184>: HTTP status code is not handled or not allowed
2026-01-10 18:49:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/embassy-khc-l-left-hinged-end-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:49:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/utility_racks/dunnage_racks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/utility_racks/dunnage_racks landed on page that is not a product page.
2026-01-10 18:49:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keyguard-lab-coat-3-pockets-elastic-wrists-snap-front-single-collar-white-md-30case>: HTTP status code is not handled or not allowed
2026-01-10 18:49:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fda-plastic-storage-container-with-casters-43-1-2-x-43-1-2-x-34-1-2>: HTTP status code is not handled or not allowed
2026-01-10 18:49:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7060-rear-blade-guide-lt-5512684>: HTTP status code is not handled or not allowed
2026-01-10 18:49:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-500-elbow-support-black-x-large>: HTTP status code is not handled or not allowed
2026-01-10 18:50:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-mil-heavy-duty-polyethylene-boot-covers-clear-lg-50box-5-boxescase>: HTTP status code is not handled or not allowed
2026-01-10 18:50:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-storage-drawer-cabinet-30x27x32-7>: HTTP status code is not handled or not allowed
2026-01-10 18:50:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-storage-drawer-cabinet-48x24x60-4>: HTTP status code is not handled or not allowed
2026-01-10 18:50:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pleated-polypropylene-bouffant-cap-100-latex-free-white-21-100bag>: HTTP status code is not handled or not allowed
2026-01-10 18:50:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-storage-drawer-cabinet-30x27x32-1>: HTTP status code is not handled or not allowed
2026-01-10 18:50:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chill-its-6200s-phase-change-cooling-vest-orange-s-m>: HTTP status code is not handled or not allowed
2026-01-10 18:50:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vfsfwdm3546t-e-ip69-1hp-1760rpm-3ph-60hz-143tc-3522m-tefc-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:50:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cross-linked-polyethylene-shoe-covers-water-resistant-blue-lg-100bag>: HTTP status code is not handled or not allowed
2026-01-10 18:50:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10372 pages (at 93 pages/min), scraped 4386 items (at 41 items/min)
2026-01-10 18:50:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vfswdm3710t-e-ip69-75hp-1770rpm-3ph-60hz-213tc-3740m-tefc>: HTTP status code is not handled or not allowed
2026-01-10 18:50:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/odorshield-tall-kitchen-drawstring-bags-13-gal-0-95-mil-lavendar-white-240-case>: HTTP status code is not handled or not allowed
2026-01-10 18:50:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/750-retracting-belt-barrier-wall-mounted-black-housing-yellow-black-belt-75-l>: HTTP status code is not handled or not allowed
2026-01-10 18:50:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-drawer-unit-divider-kit-8-compartment-15>: HTTP status code is not handled or not allowed
2026-01-10 18:50:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-1400-universal-size-back-support-black-one-size>: HTTP status code is not handled or not allowed
2026-01-10 18:50:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pilot-20-disc-sndr-item52-4421-5644871>: HTTP status code is not handled or not allowed
2026-01-10 18:50:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clean-care-bathroom-tissue-septic-safe-170-sheets-roll-12-rolls-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:50:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-roof-panel-replacment-with-hardware-global-shelter>: HTTP status code is not handled or not allowed
2026-01-10 18:50:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/allergen-filtration-paper-shakeout-10-pack-bags-for-mpwr-ch93619-ah10231>: HTTP status code is not handled or not allowed
2026-01-10 18:50:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x-1-1-4-drywall-screw-phillips-bugle-head-black-phosphate-tek-self-drilling-pt-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/medical_cabinets/multi_use_wall_mount_medical_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:50:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chill-its-6630-high-performance-cap-blue-one-size>: HTTP status code is not handled or not allowed
2026-01-10 18:50:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-beard-net-honeycomb-116-hole-100-latex-free-black-18-100bag->: HTTP status code is not handled or not allowed
2026-01-10 18:50:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-cutter-for-3-4-1-1-4-steel-strapping>: HTTP status code is not handled or not allowed
2026-01-10 18:50:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carewipes-glass-lcd-wipes-6-case>: HTTP status code is not handled or not allowed
2026-01-10 18:50:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ep-ms1a-c-earpiece-1a-tubeless-listen-only-3-5mm-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:50:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/am73915mztl-edge-handheld-digital-microscope-with-polarizer-5mp-10x-140x>: HTTP status code is not handled or not allowed
2026-01-10 18:50:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sms-lab-coat-no-pockets-elastic-wrists-snap-front-single-collar-blue-3xl-30case>: HTTP status code is not handled or not allowed
2026-01-10 18:50:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-350-gel-knee-pad-black-one-size>: HTTP status code is not handled or not allowed
2026-01-10 18:50:31 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/medical_cabinets/multi_use_wall_mount_medical_cabinets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/medical_cabinets/multi_use_wall_mount_medical_cabinets landed on page that is not a product page.
2026-01-10 18:50:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sms-coverall-elastic-wrists-ankles-zipper-front-single-collar-blue-3xl-25case>: HTTP status code is not handled or not allowed
2026-01-10 18:50:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500ml-natural-hdpe-oblong-bottle-with-43-400-white-pp-cap-24-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/tables/cafeteria_restaurant_bar_tables already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:50:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lightweight-polyethylene-isolation-gown-with-rear-entry-55l-white-25bag-4-bagcase>: HTTP status code is not handled or not allowed
2026-01-10 18:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:50:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desk-bridge-42wx24dx29-5h-driftwood>: HTTP status code is not handled or not allowed
2026-01-10 18:50:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-adjustable-solid-brute-shelf-18-wx42-l>: HTTP status code is not handled or not allowed
2026-01-10 18:50:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bullet-office-desk-71wx35d-driftwood>: HTTP status code is not handled or not allowed
2026-01-10 18:50:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vogue-outdoor-stackable-chair-denim-blue-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 18:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/task_desk_chairs/task_office_chairs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:50:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelite-shelf-divider-24>: HTTP status code is not handled or not allowed
2026-01-10 18:50:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2oz-natural-hdpe-wide-mouth-lab-style-bottle-with-28-415-natural-pp-linerless-cap-72pk>: HTTP status code is not handled or not allowed
2026-01-10 18:50:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/door-kit-30-storage-cabinet-695515>: HTTP status code is not handled or not allowed
2026-01-10 18:50:43 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/tables/cafeteria_restaurant_bar_tables> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/tables/cafeteria_restaurant_bar_tables landed on page that is not a product page.
2026-01-10 18:50:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vogue-outdoor-stackable-chair-black-pack-of-16>: HTTP status code is not handled or not allowed
2026-01-10 18:50:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fmt-10-forklift-mortar-tub-11-cu-ft-capacity-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:50:45 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents landed on page that is not a product page.
2026-01-10 18:50:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/handle-assembly-for-manual-pallet-jack-truck-mo-18e1-fits-model-eco-i-55-newer>: HTTP status code is not handled or not allowed
2026-01-10 18:50:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1oz-clear-graduated-medium-round-with-33-400-black-phenolic-polycone-lined-cap-48pk>: HTTP status code is not handled or not allowed
2026-01-10 18:50:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jet-jtm-949evs-mill-3-axis-newall-dp700-dro-quill-x-y-and-z-axis-powerfeeds-690650>: HTTP status code is not handled or not allowed
2026-01-10 18:50:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/task_desk_chairs/task_office_chairs>: HTTP status code is not handled or not allowed
2026-01-10 18:50:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/32oz-boston-round-bottle-w-33-400-blk-phen-polycone-lined-cap-vacuum-ionized-12pk>: HTTP status code is not handled or not allowed
2026-01-10 18:50:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8981-filament-tape-1-x-60-yds-66-mil-clear-36pack>: HTTP status code is not handled or not allowed
2026-01-10 18:50:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/warn-w-es-portable-anchor-plate-12v-w-es>: HTTP status code is not handled or not allowed
2026-01-10 18:50:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-waste-windshield-center-black>: HTTP status code is not handled or not allowed
2026-01-10 18:50:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tropical-fruit-nut-2-oz>: HTTP status code is not handled or not allowed
2026-01-10 18:50:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-18w-x-24l-1-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:50:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ratchet-lever-hoist-1-12-ton-cap-20-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:50:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kennedy-174-275xb-52611b-27-w-x-18-d-x-53-h-16-drawer-roller-cabinet-machinest-chest-combo>: HTTP status code is not handled or not allowed
2026-01-10 18:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/tool_storage/chests_roller_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:50:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7020-slide-bracket--ref-163-5714271>: HTTP status code is not handled or not allowed
2026-01-10 18:51:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triumph-style-t1hd-hss-jobbers-drill-black-bronze-oxide-14-12>: HTTP status code is not handled or not allowed
2026-01-10 18:51:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triumph-style-t1c-cobalt-jobbers-drill-bronze-oxide-14-12>: HTTP status code is not handled or not allowed
2026-01-10 18:51:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-container-site-box-od-45-x-22-1-2-x-31-with-casters-3>: HTTP status code is not handled or not allowed
2026-01-10 18:51:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/food-safe-vfswdm3555t-e-ip69-2hp-3450rpm-3ph-60hz-145tc-3532m-tefc-f1>: HTTP status code is not handled or not allowed
2026-01-10 18:51:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-corner-guard-with-safety-first-message-24-h-center-24-l-x-12-h-side>: HTTP status code is not handled or not allowed
2026-01-10 18:51:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/birdcontrol-bird-xbirdproofliquid-640239>: HTTP status code is not handled or not allowed
2026-01-10 18:51:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fruities-grape-chewy-candy>: HTTP status code is not handled or not allowed
2026-01-10 18:51:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10465 pages (at 93 pages/min), scraped 4425 items (at 39 items/min)
2026-01-10 18:51:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-4000-single-strap-wrist-support-tan-large-left>: HTTP status code is not handled or not allowed
2026-01-10 18:51:10 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/tool_storage/chests_roller_cabinets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/tool_storage/chests_roller_cabinets landed on page that is not a product page.
2026-01-10 18:51:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21-x-70mm-4-dram-amber-vial-w-18-400-green-thermoset-f217-ptfe-lined-cap-144pk>: HTTP status code is not handled or not allowed
2026-01-10 18:51:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-with-wood-decking-60x18x72-starter>: HTTP status code is not handled or not allowed
2026-01-10 18:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/wall_mount_belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:51:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-breathable-pants-waterproof-hi-viz-yellow-3xl>: HTTP status code is not handled or not allowed
2026-01-10 18:51:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/queuepro-twin-black-post-retracting-belt-barrier-ada-compliant-11-ft-black-belt>: HTTP status code is not handled or not allowed
2026-01-10 18:51:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-static-reclosable-poly-bags-20w-x-20l-4-mil-pink-500pack>: HTTP status code is not handled or not allowed
2026-01-10 18:51:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/weathermaster-xtra-red-post-belt-barrier-3w-x-11-ft-red-authorized-belt>: HTTP status code is not handled or not allowed
2026-01-10 18:51:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lookout-plus-gen-3-amber-led-clear-lens-52-light-bar-7950-a>: HTTP status code is not handled or not allowed
2026-01-10 18:51:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-parka-hi-viz-yellow-xl>: HTTP status code is not handled or not allowed
2026-01-10 18:51:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gear-box-pulley-5784181>: HTTP status code is not handled or not allowed
2026-01-10 18:51:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-block-grip-rubber-runner-mat-2mm-x-4-x-11-rubber-rolls-black>: HTTP status code is not handled or not allowed
2026-01-10 18:51:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-block-grip-rubber-runner-mat-2mm-x-4-x-40-rubber-rolls-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:51:23 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/wall_mount_belts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/wall_mount_belts landed on page that is not a product page.
2026-01-10 18:51:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xd-smooth-aluminum-underbody-with-barn-door-18x24x48-1705425>: HTTP status code is not handled or not allowed
2026-01-10 18:51:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-eight-sheet-handheld-1-4-hole-punch-metal-with-rubber-grip-black>: HTTP status code is not handled or not allowed
2026-01-10 18:51:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steer-mount-bucket-low-profile-66w>: HTTP status code is not handled or not allowed
2026-01-10 18:51:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-duty-stainless-steel-wire-rope-thimble-1-16-diameter>: HTTP status code is not handled or not allowed
2026-01-10 18:51:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forkli-battery-transfer-platform-4000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/binders_covers/dividers_tabs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:51:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grid-max-100-sq-ft-kit-vinyl-smoked-pewter-282-27>: HTTP status code is not handled or not allowed
2026-01-10 18:51:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-30w-x-40l-3-mil-clear-100pack>: HTTP status code is not handled or not allowed
2026-01-10 18:51:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-wheel-tire-chock-10-l-x-7-w-x-8-h-each-with-safety-sign>: HTTP status code is not handled or not allowed
2026-01-10 18:51:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pulsar-ppg1221-21in-deck-140cc-gas-push-lawn-mower-briggs-and-stratton-engine-mulching-and-bagging-option>: HTTP status code is not handled or not allowed
2026-01-10 18:51:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insul-sheet-roll-s2s-1-24870>: HTTP status code is not handled or not allowed
2026-01-10 18:51:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acrylic-safety-ppe-dispenser-visitor-specs-deluxe-by-e-glasg-d>: HTTP status code is not handled or not allowed
2026-01-10 18:51:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/373-contact-adhesive-1-quart>: HTTP status code is not handled or not allowed
2026-01-10 18:51:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lock-sleeve-jdp-20evs-20evs-c34>: HTTP status code is not handled or not allowed
2026-01-10 18:51:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-plastic-document-frame-for-11-x-14-insert-w-mat-metallic-silver>: HTTP status code is not handled or not allowed
2026-01-10 18:51:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-one-aluminum-document-box-2-5-capacity-holds-8-1-2w-x-11h-silver>: HTTP status code is not handled or not allowed
2026-01-10 18:51:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-shelf-truck-with-dolly-base-36x24x70-1600-pound-capacity>: HTTP status code is not handled or not allowed
2026-01-10 18:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/address_shipping_labels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:51:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/binders_covers/dividers_tabs>: HTTP status code is not handled or not allowed
2026-01-10 18:51:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anchor-6020s-grey-nylonknit-dk-grey-foam-palm-6020-s>: HTTP status code is not handled or not allowed
2026-01-10 18:51:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vari-angle-worktable-steel-31-w-x-30-d-x-40-h>: HTTP status code is not handled or not allowed
2026-01-10 18:51:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-liner-16-bushel-blue-vinyl-basket-truck-bulk-truck>: HTTP status code is not handled or not allowed
2026-01-10 18:51:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/410kas6orj-safety-padlock-1-12h-shackle-orange-6set>: HTTP status code is not handled or not allowed
2026-01-10 18:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/address_shipping_labels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:51:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gloves-latex-5mil-med-wht>: HTTP status code is not handled or not allowed
2026-01-10 18:51:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-selfstick-notes-3-x-5-yellow-12-100sheet-padspack>: HTTP status code is not handled or not allowed
2026-01-10 18:51:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-selfstick-notes-112-x-2-yellow-12-100sheet-padpack>: HTTP status code is not handled or not allowed
2026-01-10 18:51:49 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/address_shipping_labels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/address_shipping_labels landed on page that is not a product page.
2026-01-10 18:51:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/411kaltteal-safety-padlock-1-12w-x-3h-shackle-teal>: HTTP status code is not handled or not allowed
2026-01-10 18:51:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-l-x-30-w-production-bench-plastic-square-edge-tan>: HTTP status code is not handled or not allowed
2026-01-10 18:51:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrow-2-arm-revers-quick-adj-55-ton-capacity-7-7-8-200-mm-open-5-7-8-150-mm-reach>: HTTP status code is not handled or not allowed
2026-01-10 18:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/paper_stationery/copy_printer_paper already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:51:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/x-large-luminator-pvc-polyester-3-piece-rainsuit-2013rxl>: HTTP status code is not handled or not allowed
2026-01-10 18:51:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-edged-mechanic-nut-splitter-class-6-1-1-4-32-mm-to-2-50-mm>: HTTP status code is not handled or not allowed
2026-01-10 18:51:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/notice-safety-glasses-required-beyond-this-point-7x10-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:51:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/notice-monitored-by-video-camera-10x14-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:51:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-l-x-36-w-production-bench-esd-safety-edge-blue-1>: HTTP status code is not handled or not allowed
2026-01-10 18:51:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-9w-x-12l-3-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:51:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/singleply-thermal-paper-rolls-318-x-230-ft-white-10pack>: HTTP status code is not handled or not allowed
2026-01-10 18:51:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-l-x-36-w-production-bench-esd-square-edge-blue-2>: HTTP status code is not handled or not allowed
2026-01-10 18:51:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/no-parking-18x12-063-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:51:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/no-overnight-parking-violators-will-be-towed-18x12-063-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:51:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/address_shipping_labels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/address_shipping_labels landed on page that is not a product page.
2026-01-10 18:52:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fuse-2a-9180-215-10>: HTTP status code is not handled or not allowed
2026-01-10 18:52:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colored-perforated-note-pads-812-x-11-blue-50sheet-dozen>: HTTP status code is not handled or not allowed
2026-01-10 18:52:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jazz-band-banded-hearingprotector-50-per-cs-6506>: HTTP status code is not handled or not allowed
2026-01-10 18:52:02 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/paper_stationery/copy_printer_paper> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/paper_stationery/copy_printer_paper landed on page that is not a product page.
2026-01-10 18:52:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/411kas3teal-safety-padlock-1-12w-x-1-12h-teal-3set>: HTTP status code is not handled or not allowed
2026-01-10 18:52:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-mid-length-twill-w-mouthpiece-navy-6-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:52:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-20w-x-28l-3-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 18:52:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-6w-x-28l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:52:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fork-separator-3-4-18-mm-opening>: HTTP status code is not handled or not allowed
2026-01-10 18:52:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10557 pages (at 92 pages/min), scraped 4456 items (at 31 items/min)
2026-01-10 18:52:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/springs-26-2464-sou1179030>: HTTP status code is not handled or not allowed
2026-01-10 18:52:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washout-construction-washout-polypropylene-lid>: HTTP status code is not handled or not allowed
2026-01-10 18:52:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chain-plastic-2-links-on-a-reel-black-125-feet-trade-size-8>: HTTP status code is not handled or not allowed
2026-01-10 18:52:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-n95-disposable-respirator-1511>: HTTP status code is not handled or not allowed
2026-01-10 18:52:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/406kas6ylw-safety-padlock-yellow-6set>: HTTP status code is not handled or not allowed
2026-01-10 18:52:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-9w-x-10l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:52:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chain-plastic-2-links-red-and-white-50-feet-trade-size-8>: HTTP status code is not handled or not allowed
2026-01-10 18:52:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/406kas12ylw-safety-padlock-yellow-12set>: HTTP status code is not handled or not allowed
2026-01-10 18:52:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/406kas12blu-safety-padlock-blue-12set>: HTTP status code is not handled or not allowed
2026-01-10 18:52:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metaltech-pig-tail-lock>: HTTP status code is not handled or not allowed
2026-01-10 18:52:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-premium-locker-single-tier-12x12x72-3-door-ready-assemble-parchment>: HTTP status code is not handled or not allowed
2026-01-10 18:52:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pathway-3g-wheelchair-ramp-kit-12ft-36-use-w-expanded-metal-two-line-handrail-3-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:52:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s1107ylw-aluminum-safety-padlock-1-12w-x-3h-shackle-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:52:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-12w-x-10l-3-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:52:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-lockout-station-unfilled-s1900>: HTTP status code is not handled or not allowed
2026-01-10 18:52:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluorescent-line-safetyvest-w-orng-sil-stripes-wccl2ll>: HTTP status code is not handled or not allowed
2026-01-10 18:52:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alcohol-free-respiratorcleaning-wipe-f-5000-504>: HTTP status code is not handled or not allowed
2026-01-10 18:52:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cross-hd-screw-316x38-jdp-20evs-20evs-t67-3>: HTTP status code is not handled or not allowed
2026-01-10 18:52:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/relays-44-1774-tuc101273>: HTTP status code is not handled or not allowed
2026-01-10 18:52:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-premium-locker-single-tier-12x12x72-3-door-assembled-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:52:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-plug-body-with-high-flow-profile-1-4-fnpt-connection-used-with-esi-coupling>: HTTP status code is not handled or not allowed
2026-01-10 18:52:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kits-44-1581-imp37110>: HTTP status code is not handled or not allowed
2026-01-10 18:52:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gusseted-poly-bags-15w-x-9d-x-23h-1-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 18:52:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elements-34-1483-lin110659sp>: HTTP status code is not handled or not allowed
2026-01-10 18:52:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-step-24in-w-steel-safety-angle-rolling-ladder-perforated-tread-gray-kdec111246>: HTTP status code is not handled or not allowed
2026-01-10 18:52:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-premium-locker-six-tier-12x18x12-18-door-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:52:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-step-24in-w-steel-safety-angle-rolling-ladder-grip-strut-gray-kdec110242>: HTTP status code is not handled or not allowed
2026-01-10 18:52:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-nexelon-21w-x-54l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 18:52:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-safety-quick-release-coupling-1-2-body-w-iso6150-profile-3-4-fnpt>: HTTP status code is not handled or not allowed
2026-01-10 18:52:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/penco-locker-single-tier-12x12x72-3-door-assembled-champagne>: HTTP status code is not handled or not allowed
2026-01-10 18:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery_clamping_positioning/lathe_chucks_accessories/lathe_chuck_parts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:52:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyurethane-spiral-hose-20-with-non-scratch-fittings-and-1-4-mnpt-thd-connections>: HTTP status code is not handled or not allowed
2026-01-10 18:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery_clamping_positioning/lathe_chucks_accessories/lathe_chucks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:52:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rod-joint-jbj22-17>: HTTP status code is not handled or not allowed
2026-01-10 18:52:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rear-handle-jbj5-25>: HTTP status code is not handled or not allowed
2026-01-10 18:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery_clamping_positioning/lathe_chucks_accessories/lathe_chuck_jaws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:52:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s1-safety-quick-coupling-3-8-automotive-profile-with-1-4-fnpt-connection>: HTTP status code is not handled or not allowed
2026-01-10 18:52:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-1-hp-roof-ventilator-2>: HTTP status code is not handled or not allowed
2026-01-10 18:52:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-8w-x-12l-6-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:52:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a30p24g-panel-nema-12-2700x2100-fits-30x24-steelzinc>: HTTP status code is not handled or not allowed
2026-01-10 18:52:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/counter-top-crt-security-computer-cabinet-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:52:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/machining/machinery_clamping_positioning/lathe_chucks_accessories/lathe_chuck_parts>: HTTP status code is not handled or not allowed
2026-01-10 18:52:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/machining/machinery_clamping_positioning/lathe_chucks_accessories/lathe_chucks>: HTTP status code is not handled or not allowed
2026-01-10 18:52:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-jaw-2-piece-scroll-chuck-semi-steel-body-plain-back-5-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:52:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/machining/machinery_clamping_positioning/lathe_chucks_accessories/lathe_chuck_jaws>: HTTP status code is not handled or not allowed
2026-01-10 18:52:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-7w-x-14l-6-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:53:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bissell-garage-pro-wet-dry-wall-mount-vacuum>: HTTP status code is not handled or not allowed
2026-01-10 18:53:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-panel-trash-sand-urn-gray-17-1-2-square-x-32-h>: HTTP status code is not handled or not allowed
2026-01-10 18:53:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerful-magnet-tool-holders-amc24plc>: HTTP status code is not handled or not allowed
2026-01-10 18:53:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-inch-ready-set-staple-tool-rsc187-6>: HTTP status code is not handled or not allowed
2026-01-10 18:53:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0-1-x-00005-0-001mm-digimatic-lite-micrometer-friction-no-spc-output>: HTTP status code is not handled or not allowed
2026-01-10 18:53:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cleaning-station-shadow-board-combo-kit-red-white-72-x-36-acp-composite>: HTTP status code is not handled or not allowed
2026-01-10 18:53:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a4412t1t-wire-trough-type-1-400x400x1200-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 18:53:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paint-ink-cabinet-self-close-door-72-gallon>: HTTP status code is not handled or not allowed
2026-01-10 18:53:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10651 pages (at 94 pages/min), scraped 4499 items (at 43 items/min)
2026-01-10 18:53:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flammable-cabinet-drum-storage-with-manual-doors>: HTTP status code is not handled or not allowed
2026-01-10 18:53:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-step-24in-w-20in-d-top-step-steel-rolling-ladder-perforated-tread-no-handrail-kdsr003246-d2>: HTTP status code is not handled or not allowed
2026-01-10 18:53:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-long-stacking-box-48-x-22-1-2-x-7-3-10-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:53:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-nexelon-21w-x-30l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:53:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/throttle-lever-jsm-401-sm-40104>: HTTP status code is not handled or not allowed
2026-01-10 18:53:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-chrome-18w-x-42l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:53:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-step-aluminum-rolling-ladder-24in-w-ribbed-tread-14in-d-top-step-36in-handrails-wlar112244>: HTTP status code is not handled or not allowed
2026-01-10 18:53:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/splined-sleeve-zx-lathes-tnmp08102>: HTTP status code is not handled or not allowed
2026-01-10 18:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/hand_tools_1/chisels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:53:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/open-end-static-shielding-bags-11w-x-15l-28-mil-transparent-100pack>: HTTP status code is not handled or not allowed
2026-01-10 18:53:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washer-jsm4540-32>: HTTP status code is not handled or not allowed
2026-01-10 18:53:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/propane-gas-infrared-heater-092120lps-straight-configuration-20-l-45000-btu>: HTTP status code is not handled or not allowed
2026-01-10 18:53:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duro-med-wooden-cane-wooden-walking-cane-wooden-walking-stick-lightweight-and-strong-made-in-the-usa-walnut>: HTTP status code is not handled or not allowed
2026-01-10 18:53:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ck80-322-contactor-3-pole-120v>: HTTP status code is not handled or not allowed
2026-01-10 18:53:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-gas-infrared-heater-092030ngs-straight-configuration-30-l-50000-btu>: HTTP status code is not handled or not allowed
2026-01-10 18:53:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/incontinence-reusable-bed-pad-with-quilted-slide-sheet-28-x-36-inches-without-straps>: HTTP status code is not handled or not allowed
2026-01-10 18:53:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-poly-z-brite-18w-x-60l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:53:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-enclosure-opaque-cover-no-knockouts-5-9-in-x-5-9-in-x-8-66-in>: HTTP status code is not handled or not allowed
2026-01-10 18:53:30 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/hand_tools_1/chisels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/hand_tools_1/chisels landed on page that is not a product page.
2026-01-10 18:53:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-designer-cane-with-offset-handle-and-strap-leopard>: HTTP status code is not handled or not allowed
2026-01-10 18:53:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-threading-pipe-and-bolt-dies-only-38345>: HTTP status code is not handled or not allowed
2026-01-10 18:53:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/22mm-non-metallic-non-illuminated-push-pull-maintained-round-mushroom-button>: HTTP status code is not handled or not allowed
2026-01-10 18:53:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-plastic-dunnage-rack-1500-lbs-capacity-1>: HTTP status code is not handled or not allowed
2026-01-10 18:53:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/face-spanner-wrenches-426>: HTTP status code is not handled or not allowed
2026-01-10 18:53:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-nexelon-21w-x-48l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:53:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheel-seat-vbs2012-7290>: HTTP status code is not handled or not allowed
2026-01-10 18:53:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamp-together-t-branch-8-8-8-8-inch-diameter-galvanized-18-gage>: HTTP status code is not handled or not allowed
2026-01-10 18:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/boards_easels/whiteboard_bulletin_board_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:53:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-products-mn-ms70-b1018-70-shade-cloth-shade-tarp-10-x-18>: HTTP status code is not handled or not allowed
2026-01-10 18:53:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/table-4-chair-set-black-polypropylene-cafe-chairs-36w-x-29h-round-gray-nebula-table>: HTTP status code is not handled or not allowed
2026-01-10 18:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/packaging/bags_covers/poly_bags_tubing_sheeting/reclosable_bags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:53:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-cap-style-6-point-snap-lock-suspension-hard-hat>: HTTP status code is not handled or not allowed
2026-01-10 18:53:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-outlet-tri-tap-adapter-with-covers-gg-03431or-orange>: HTTP status code is not handled or not allowed
2026-01-10 18:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery/machinery_parts_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:53:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gusseted-poly-bags-10w-x-8d-x-24h-4-mil-clear-250pack>: HTTP status code is not handled or not allowed
2026-01-10 18:53:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-conical-vibration-shock-absorption-mount-10-24-thread-25-ft-lbs-max-load>: HTTP status code is not handled or not allowed
2026-01-10 18:53:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cast-iron-grip-handle-weights-nist-class-f-with-traceable-certificate-25-lbs>: HTTP status code is not handled or not allowed
2026-01-10 18:53:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-gallon-solution-tank-floor-machine-1>: HTTP status code is not handled or not allowed
2026-01-10 18:53:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/boards_easels/whiteboard_bulletin_board_accessories>: HTTP status code is not handled or not allowed
2026-01-10 18:53:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spacer-bdb-1340-4716>: HTTP status code is not handled or not allowed
2026-01-10 18:53:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/packaging/bags_covers/poly_bags_tubing_sheeting/reclosable_bags>: HTTP status code is not handled or not allowed
2026-01-10 18:53:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/turbotoe-steel-toe-cap-overshoe-lrg-10-13-flexible-pliable-pvc-antislip-sole-waterproof>: HTTP status code is not handled or not allowed
2026-01-10 18:53:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pinion-shaft-ghd-20pf-2450021>: HTTP status code is not handled or not allowed
2026-01-10 18:53:54 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/machining/machinery/machinery_parts_accessories> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/machining/machinery/machinery_parts_accessories landed on page that is not a product page.
2026-01-10 18:53:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8959-bi-directional-filament-tape-1-x-55-yds-57-mil-clear-36pack>: HTTP status code is not handled or not allowed
2026-01-10 18:53:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rendezvous-eyewear-clear-anti-fog-lens-with-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:53:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-static-flat-poly-bags-3w-x-7l-4-mil-pink-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:53:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-half-pallet-skid-bottom-solid-top-48x24>: HTTP status code is not handled or not allowed
2026-01-10 18:53:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cabinets-aah-48rbmag1-g-storage-cabinet-assembled-48x24x72-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/pens already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:54:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4959-double-sided-foam-tape-34-x-5-yds-120-mil-white>: HTTP status code is not handled or not allowed
2026-01-10 18:54:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-cylinder-multi-paklarge-air-cart-4-out-4500-psi-alarm-whistle-schrader-mp-2300enb>: HTTP status code is not handled or not allowed
2026-01-10 18:54:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sj4570-low-profile-fasteners-1w-x-150l-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/laundry_detergent already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:54:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4032-double-sided-foam-tape-1-x-72-yds-3125-mil-natural>: HTTP status code is not handled or not allowed
2026-01-10 18:54:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cabinets-fs-30-g-storage-cabinet-assembled-30x18x72-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:54:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-chain-3-4-link-25-l-hdpe-black>: HTTP status code is not handled or not allowed
2026-01-10 18:54:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hon-310-series-4-drawer-vertical-file-26-d-letter-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:54:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10743 pages (at 92 pages/min), scraped 4538 items (at 39 items/min)
2026-01-10 18:54:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cabinets-bca-363018-g-bookcase-assembled-36x18x30-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:54:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-w-x-36-d-production-workbench-esd-laminate-safety-edge-with-drawers-shelf-tan>: HTTP status code is not handled or not allowed
2026-01-10 18:54:11 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/pens> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/pens landed on page that is not a product page.
2026-01-10 18:54:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-w-power-riser>: HTTP status code is not handled or not allowed
2026-01-10 18:54:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cabinets-bca-364213-g-bookcase-assembled-36x13x42-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:54:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/cleaning_chemicals_lubricants/laundry_detergent>: HTTP status code is not handled or not allowed
2026-01-10 18:54:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-foot-x-15-foot-forest-green-tarp>: HTTP status code is not handled or not allowed
2026-01-10 18:54:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4936-double-sided-foam-tape-12-x-5-yds-25-mil-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:54:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/offices-to-go-2-drawer-pedestal-in-walnut-executive-modular-furniture>: HTTP status code is not handled or not allowed
2026-01-10 18:54:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-general-purpose-masking-tape-3-4-x-60yds-3-core-6-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:54:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-portable-parts-organizer-5-removable-compartments>: HTTP status code is not handled or not allowed
2026-01-10 18:54:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6802-classic-trapper-hat-l-xl-lime>: HTTP status code is not handled or not allowed
2026-01-10 18:54:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-pocket-oak-wall-rack-medium-oak>: HTTP status code is not handled or not allowed
2026-01-10 18:54:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fibre-disc-782c-tn-quick-change-4-1-2-80-25-per-inner-100-per-case>: HTTP status code is not handled or not allowed
2026-01-10 18:54:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/074-822-5bk-cat-6-utp-mold-injection-snagless-patch-cord-5-ft-black>: HTTP status code is not handled or not allowed
2026-01-10 18:54:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adapter-ref-4--1230-5232481>: HTTP status code is not handled or not allowed
2026-01-10 18:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/guest_chairs/guest_reception_chairs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:54:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-roller-chain-60-1r-3-4-pitch-50ft-reel>: HTTP status code is not handled or not allowed
2026-01-10 18:54:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/upper-hanger-dc-1900-text-430038>: HTTP status code is not handled or not allowed
2026-01-10 18:54:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-nickel-plated-roller-chain-35-1np-3-8-pitch-connecting-link>: HTTP status code is not handled or not allowed
2026-01-10 18:54:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-foam-tape-34-x-36-yds-125-mil-white-2pack>: HTTP status code is not handled or not allowed
2026-01-10 18:54:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fibre-disc-787c-120-4-1-2-x-7-8-in-die-450e-25-per-inner-100-per-case>: HTTP status code is not handled or not allowed
2026-01-10 18:54:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-roller-chain-140-1r-1-3-4-pitch-10ft-box>: HTTP status code is not handled or not allowed
2026-01-10 18:54:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f9469pc-double-sided-adhesive-transfer-tape-1-x-5-yds-5-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:54:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-bands-size-18-3-x-116-400-bands14lb-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:54:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/seating/task_desk_chairs_1/guest_chairs/guest_reception_chairs>: HTTP status code is not handled or not allowed
2026-01-10 18:54:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-4w-x-7l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:54:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-lower-plastic-cover-for-761217-761218>: HTTP status code is not handled or not allowed
2026-01-10 18:54:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fiberglass-tote-box-25-1-4-x-18-x-6-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:54:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-w-3-drawer-binder-lateral-file-putty-1>: HTTP status code is not handled or not allowed
2026-01-10 18:54:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-foot-x-20-foot-heavy-duty-silver-tarp>: HTTP status code is not handled or not allowed
2026-01-10 18:54:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-nickel-plated-roller-chain-50-1np-5-8-pitch-100ft-reel>: HTTP status code is not handled or not allowed
2026-01-10 18:54:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/purofort-full-safety-mens-work-boots-size-15-green>: HTTP status code is not handled or not allowed
2026-01-10 18:54:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-plunger-can-1-quart-polyethylene>: HTTP status code is not handled or not allowed
2026-01-10 18:54:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-wheel-kit-for-manual-pallet-jack-gwk-hpt28u-ck-fits-toyota-model-hpt28u>: HTTP status code is not handled or not allowed
2026-01-10 18:54:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wood-crate-with-1-polyethylene-foam-lining-four-way-entry-96-l-x-24-w-x-31-12-h>: HTTP status code is not handled or not allowed
2026-01-10 18:54:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/penco-recessed-handle-triple-tier-locker-12x15x24-unassembled-1-wide-champagne>: HTTP status code is not handled or not allowed
2026-01-10 18:54:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/41422-nylon-blast-suit-blue-large-nylon-cotton>: HTTP status code is not handled or not allowed
2026-01-10 18:54:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wood-crate-with-1-polyethylene-foam-lining-four-way-entry-72-l-x-48-w-x-55-12-h>: HTTP status code is not handled or not allowed
2026-01-10 18:54:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-9w-x-14l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:54:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40048-1-8-air-jet-15-cfm-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:54:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triango-universal-led-treatment-light-100-3-f-dimming-color-changing-floor-stand>: HTTP status code is not handled or not allowed
2026-01-10 18:54:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-step-75-incline-ladder-24-inch-w-perforated>: HTTP status code is not handled or not allowed
2026-01-10 18:54:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-electric-pallet-jack-gwk-pmx45-lw-xl-fits-bt-prime-mover-model-pmx-45>: HTTP status code is not handled or not allowed
2026-01-10 18:54:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/05040su-f4t5cw-4w-fluorescent-t5-bulb-mini-bipin-cool-white>: HTTP status code is not handled or not allowed
2026-01-10 18:54:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-steel-rolling-ladder-grip-strut>: HTTP status code is not handled or not allowed
2026-01-10 18:54:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-step-steel-rolling-ladder-grip-strut>: HTTP status code is not handled or not allowed
2026-01-10 18:54:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40372-nozzle-kit-ceramic-steel-rubber>: HTTP status code is not handled or not allowed
2026-01-10 18:55:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-block-reclosable-poly-bags-10w-x-13l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:55:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-shelf-bookcase-mahogany-executive-modular-furniture>: HTTP status code is not handled or not allowed
2026-01-10 18:55:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/additional-shelves-for-36w-storage-cabinet-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:55:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/120-racetrack-conference-table-mahogany-executive-modular-furniture>: HTTP status code is not handled or not allowed
2026-01-10 18:55:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-deluxe-3-shelf-plastic-utility-service-cart-5-rubber-casters>: HTTP status code is not handled or not allowed
2026-01-10 18:55:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-diamond-grip-rubber-runner-mats-2mm-x-4-x-13-rubber-flooring-rolls-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:55:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-diamond-grip-rubber-runner-mats-2mm-x-4-x-13-rubber-flooring-rolls-black>: HTTP status code is not handled or not allowed
2026-01-10 18:55:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-pedal-20-5x30x10-641244-641264-floor-scrubbers>: HTTP status code is not handled or not allowed
2026-01-10 18:55:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-jjp8bt-145>: HTTP status code is not handled or not allowed
2026-01-10 18:55:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10840 pages (at 97 pages/min), scraped 4580 items (at 42 items/min)
2026-01-10 18:55:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-polypropylene-bags-12l-x-12w-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:55:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perma-patch-all-season-asphalt-repair-material-60-lb-bag>: HTTP status code is not handled or not allowed
2026-01-10 18:55:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-20w-x-20l-4-mil-clear-250pack>: HTTP status code is not handled or not allowed
2026-01-10 18:55:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speakman-anystream-napa-5-jet-showerhead-polished-chrome-finish-2-5-gpm>: HTTP status code is not handled or not allowed
2026-01-10 18:55:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speakman-anystream-icon-8-jet-showerhead-polished-brass-finish-2-5-gpm>: HTTP status code is not handled or not allowed
2026-01-10 18:55:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss-single-mesh-strainer-6-1-4-fine>: HTTP status code is not handled or not allowed
2026-01-10 18:55:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4150059-siphon-gun-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:55:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fixed-tight-cllr-thread-jmd15-026>: HTTP status code is not handled or not allowed
2026-01-10 18:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/office_machines/office_machine_accessories/3d_printer_filaments_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:55:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/method-3d-printer>: HTTP status code is not handled or not allowed
2026-01-10 18:55:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/method-x-asa-filament-black>: HTTP status code is not handled or not allowed
2026-01-10 18:55:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/minigrip-anti-static-reclosable-poly-bags-4w-x-6l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:55:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/minigrip-anti-static-reclosable-poly-bags-6w-x-8l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:55:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-mobile-packing-workbench-esd-square-edge-60-x-36>: HTTP status code is not handled or not allowed
2026-01-10 18:55:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eterna-spindle-assembly-left-hand-cold>: HTTP status code is not handled or not allowed
2026-01-10 18:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/portable_electric_heaters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:55:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-polypropylene-bags-9l-x-6w-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:55:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/17-sand-screen-disc-80-grit-10-per-case>: HTTP status code is not handled or not allowed
2026-01-10 18:55:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/office_machines/office_machine_accessories/3d_printer_filaments_accessories> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/office_machines/office_machine_accessories/3d_printer_filaments_accessories landed on page that is not a product page.
2026-01-10 18:55:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screw-2695025>: HTTP status code is not handled or not allowed
2026-01-10 18:55:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-romeo-pull-on-work-boots-size-13w-black>: HTTP status code is not handled or not allowed
2026-01-10 18:55:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/food-grade-55-gallon-double-action-drum-pump>: HTTP status code is not handled or not allowed
2026-01-10 18:55:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stanco-welders-wear-welding-coat-w630-xl>: HTTP status code is not handled or not allowed
2026-01-10 18:55:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14inx30in-5-pack-shelf-accessory-kit-for-lifetime-sheds>: HTTP status code is not handled or not allowed
2026-01-10 18:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/drum_handling_equipment/drum_covers_inserts_liners already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:55:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hndl-jsg-0522-ap-70047>: HTTP status code is not handled or not allowed
2026-01-10 18:55:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/hvac/heaters/electric_heaters/portable_electric_heaters>: HTTP status code is not handled or not allowed
2026-01-10 18:55:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/valley-craft-vari-tuff-mobile-utility-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 18:55:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/downrod-8-wh-color-for-cp48dw-cp56dw-cp60dw-with-lead-wire-and-safety-cable>: HTTP status code is not handled or not allowed
2026-01-10 18:55:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/minigrip174-reclosable-poly-bags-5w-x-8l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 18:55:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-36-6-drawer-with-steel-top-workbench>: HTTP status code is not handled or not allowed
2026-01-10 18:55:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-steel-left-return-desk-24-48-charcoal-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 18:55:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx-power-workstation-hutch-84w-x-30d-x-22-14h-blue-with-black-handle>: HTTP status code is not handled or not allowed
2026-01-10 18:55:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lifetime-8ft-x12ft-6in-storage-building-with-win-dows>: HTTP status code is not handled or not allowed
2026-01-10 18:55:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/janitorial-shadow-board-combo-kit-green-on-white-general-purpose-composite-sbk104acp>: HTTP status code is not handled or not allowed
2026-01-10 18:55:43 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/material-handling/drum_handling_equipment/drum_covers_inserts_liners> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/material-handling/drum_handling_equipment/drum_covers_inserts_liners landed on page that is not a product page.
2026-01-10 18:55:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/table-fixer-screw-20-disc-sander-5644851>: HTTP status code is not handled or not allowed
2026-01-10 18:55:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nilium-174-water-soluble-deodorizer-orange-nilium-gallon-bottle-4-bottles-case>: HTTP status code is not handled or not allowed
2026-01-10 18:55:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/afe8x8-flush-cover-for-pull-box-fits-800x800-950-x-950-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 18:55:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mapa-solo-green-977-disposable-nitrile-gloves-powder-free-100-box-size-9-977019>: HTTP status code is not handled or not allowed
2026-01-10 18:55:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/java-one-single-cup-tropical-citrus-green-tea-pods-14-pods-box>: HTTP status code is not handled or not allowed
2026-01-10 18:55:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterhog-fashion-diamond-mat-navy-4-x-10>: HTTP status code is not handled or not allowed
2026-01-10 18:55:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterhog-classic-diamond-mat-evergreen-4-x-16>: HTTP status code is not handled or not allowed
2026-01-10 18:55:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inlet-guide-ag4s-44>: HTTP status code is not handled or not allowed
2026-01-10 18:55:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nut-6296113>: HTTP status code is not handled or not allowed
2026-01-10 18:55:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oven-grill-cleaner-gallon-bottle-unscented-4-case>: HTTP status code is not handled or not allowed
2026-01-10 18:55:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterhog-fashion-diamond-mat-red-black-4-x-6>: HTTP status code is not handled or not allowed
2026-01-10 18:55:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-231ha-2-impactool>: HTTP status code is not handled or not allowed
2026-01-10 18:55:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nilozyme-153-trap-drain-treatment-fresh-scent-gallon-bottle-4-bottles-case>: HTTP status code is not handled or not allowed
2026-01-10 18:55:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pop-up-notes-super-sticky-3-x-3-assorted-neon-colors-6-pk>: HTTP status code is not handled or not allowed
2026-01-10 18:56:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/91105-complete-empty-lockable-station>: HTTP status code is not handled or not allowed
2026-01-10 18:56:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a1412chfl-continuous-hinge-wquick-turn-fast-latch-type-4-1400x1200x600-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 18:56:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-5108max-die-grinder-040-hp>: HTTP status code is not handled or not allowed
2026-01-10 18:56:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-plastic-garbage-can-with-lid-dolly-44-gal-white>: HTTP status code is not handled or not allowed
2026-01-10 18:56:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exq-pro-roller-cabinet-55w-x-30d-x-46-58h-blue-with-chrome-drawer-pulls-trim>: HTTP status code is not handled or not allowed
2026-01-10 18:56:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-jsg-0470-829049>: HTTP status code is not handled or not allowed
2026-01-10 18:56:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedi-boot-torpedo-end-register-vent-boot-w-adj-hangers-for-hvac-duct-work-2-x-12-x-6>: HTTP status code is not handled or not allowed
2026-01-10 18:56:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedi-grille-return-air-vent-grille-vent-cover-20-x-20>: HTTP status code is not handled or not allowed
2026-01-10 18:56:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 10937 pages (at 97 pages/min), scraped 4622 items (at 42 items/min)
2026-01-10 18:56:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/back-up-alarm-with-beep-beep-sound>: HTTP status code is not handled or not allowed
2026-01-10 18:56:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a903636fsda-free-stand-singledual-access-1-door-9006x3606x3606-steelpaint>: HTTP status code is not handled or not allowed
2026-01-10 18:56:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90-176-ss-corner-guard-16-ga-3-8-wings-sq-corners-48-lx1-1-2-wx1-1-2-h>: HTTP status code is not handled or not allowed
2026-01-10 18:56:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solarguard-storage-master-building-14w-x-14h-x-28l-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:56:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30x12x72-solar-star-greenhouse-w-poly-top-and-ends-roll-up-sides>: HTTP status code is not handled or not allowed
2026-01-10 18:56:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-solid-galvanized-steel-shelving-add-on-unit-5-tier-72w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:56:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/table-insert-64a-6290694>: HTTP status code is not handled or not allowed
2026-01-10 18:56:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-safety-net-4-foot-l-by-26-foot-w-fits-7-3-4-inches-to-8-5-8-inches-dia-brsn-426-9>: HTTP status code is not handled or not allowed
2026-01-10 18:56:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delta-aluminum-220-series-portable-chest-57-inch-l>: HTTP status code is not handled or not allowed
2026-01-10 18:56:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-computer-station-with-monitor-arm-36w-x-24d-x-33-1-2h-black>: HTTP status code is not handled or not allowed
2026-01-10 18:56:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-wire-shelving-starter-unit-5-tier-36w-x-18d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 18:56:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n728022-ell-20-rectangular-boom>: HTTP status code is not handled or not allowed
2026-01-10 18:56:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-wire-shelving-starter-unit-5-tier-48w-x-24d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 18:56:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d730251-cbo-moovi-anchor-base>: HTTP status code is not handled or not allowed
2026-01-10 18:56:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carly-utility-tong-8-2732clear>: HTTP status code is not handled or not allowed
2026-01-10 18:56:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/expanding-zipper-pouch-clear-mesh-black>: HTTP status code is not handled or not allowed
2026-01-10 18:56:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-14-x-14-6295436>: HTTP status code is not handled or not allowed
2026-01-10 18:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:56:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8090253249-iron-series-two-stage-horizontal-air-compressor-10hp-120-gallon>: HTTP status code is not handled or not allowed
2026-01-10 18:56:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shaft-20-planer-mdl-208-6292655>: HTTP status code is not handled or not allowed
2026-01-10 18:56:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrow-5vx-cogged-v-belt-5vx1250>: HTTP status code is not handled or not allowed
2026-01-10 18:56:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-view-greenhouse-kit-30w-x-12h-x-72l-natural-gas>: HTTP status code is not handled or not allowed
2026-01-10 18:56:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wkt3-danger-do-not-operate-locked-out-tag-two-part-tags-with-stubs-cardstock-25pack>: HTTP status code is not handled or not allowed
2026-01-10 18:56:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8090250035-elite-two-stage-vertical-air-compressor-75hp-80-gallon>: HTTP status code is not handled or not allowed
2026-01-10 18:56:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-seal-bubble-mailers-4-9-12w-x-14-12l-kraft-25pack>: HTTP status code is not handled or not allowed
2026-01-10 18:56:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classical-cogged-bx-v-belt-bx43>: HTTP status code is not handled or not allowed
2026-01-10 18:56:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 18:56:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrow-3vx-cogged-v-belt-3vx335>: HTTP status code is not handled or not allowed
2026-01-10 18:56:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classical-cogged-bx-v-belt-bx70>: HTTP status code is not handled or not allowed
2026-01-10 18:56:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/71565-danger-high-voltage-sign-fiberglass-10w-x-7h>: HTTP status code is not handled or not allowed
2026-01-10 18:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:56:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelving-add-on-unit-5-tier-60w-x-24d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 18:56:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durable-vinyl-view-binder-2-capacity-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:56:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/80076-do-not-enter-sign-high-intensity-prismatic-reflective-sign-aluminum-24w-x-24h>: HTTP status code is not handled or not allowed
2026-01-10 18:56:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magic-tape-value-pack-3-4-x-1000-1-core-clear-20-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/crowd_control/crowd_control_barricades already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:56:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500-1-8-diameter-7x7-stainless-steel-aircraft-cable>: HTTP status code is not handled or not allowed
2026-01-10 18:56:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gear-model-201-planer-6012037>: HTTP status code is not handled or not allowed
2026-01-10 18:56:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelate-silver-epoxy-wire-shelving-starter-unit-5-tier-60w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:56:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/146132-cable-safety-padlocks-keyed-alike-8h-clearance-steel-cable-red-6pack>: HTTP status code is not handled or not allowed
2026-01-10 18:56:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bubble-lined-poly-mailers-9-12w-x-14-12l-2-mil-white-25pack>: HTTP status code is not handled or not allowed
2026-01-10 18:56:52 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/spill_control_supplies/absorbents landed on page that is not a product page.
2026-01-10 18:56:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grade-30-proof-coil-chain-3-16-dia-750-lb-cap-10-box-bright-zinc>: HTTP status code is not handled or not allowed
2026-01-10 18:56:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/padded-mailers-0-6w-x-10l-kraft-250pack>: HTTP status code is not handled or not allowed
2026-01-10 18:56:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bushing-20-planer-md-208-6292635>: HTTP status code is not handled or not allowed
2026-01-10 18:56:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/crowd_control/crowd_control_barricades>: HTTP status code is not handled or not allowed
2026-01-10 18:56:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stayflats-plus-peel-seal-mailers-17w-x-21l-kraft-100pack>: HTTP status code is not handled or not allowed
2026-01-10 18:56:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grade-30-proof-coil-chain-3-8-dia-2650-lb-cap-66-pail-hot-galv>: HTTP status code is not handled or not allowed
2026-01-10 18:57:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sparta-nylon-handle-48>: HTTP status code is not handled or not allowed
2026-01-10 18:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:57:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/document-envelopes-10l-x-12w-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 18:57:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-x-8-x-8-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:57:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-bar-48-l-x-2-w-x-1-4-thick-yellow>: HTTP status code is not handled or not allowed
2026-01-10 18:57:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelving-add-on-unit-5-tier-48w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:57:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-forgemaster-5x7-rigid-8x2-12-plastex-roller-2000lb>: HTTP status code is not handled or not allowed
2026-01-10 18:57:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-12-x-48-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/spill_control_supplies/chemical_sorbents_spill_kits/spill_kits_stations already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:57:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelving-starter-unit-5-tier-24w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 18:57:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11033 pages (at 96 pages/min), scraped 4664 items (at 42 items/min)
2026-01-10 18:57:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vital-cluster-box-unit-w-vogue-classic-accessories-8-mailboxes-4-parcel-lockers-postal-grey>: HTTP status code is not handled or not allowed
2026-01-10 18:57:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polystyrene-bar-24-l-x-2-w-x-3-32-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 18:57:11 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 18:57:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700356pur-pegboard-powerwing-display-1675w-x-60h-pl-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 18:57:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-ace-tuf-wheel-8x250-58-ball>: HTTP status code is not handled or not allowed
2026-01-10 18:57:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-do-not-bend-print-5l-x-3w-redwhite-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 18:57:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs>: HTTP status code is not handled or not allowed
2026-01-10 18:57:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelving-starter-unit-5-tier-30w-x-18d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 18:57:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/spill_control_supplies/chemical_sorbents_spill_kits/spill_kits_stations>: HTTP status code is not handled or not allowed
2026-01-10 18:57:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700460gre-pinwheel-pegboard-display-wrb-135w-x-60h-gn-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 18:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/foam/foam_tubes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:57:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelving-add-on-unit-5-tier-42w-x-21d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 18:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:57:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/86533-danger-do-not-use-tag-2-sided-25pkg-polyester-3w-x-5-34h>: HTTP status code is not handled or not allowed
2026-01-10 18:57:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-x-16-x-15-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:57:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stock-limiter-model-201-planer-6012171>: HTTP status code is not handled or not allowed
2026-01-10 18:57:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/switch-230v3ph-model-201-plnr-6012294>: HTTP status code is not handled or not allowed
2026-01-10 18:57:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-x-14-x-18-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:57:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelving-add-on-unit-5-tier-42w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 18:57:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelite-vented-plastic-shelving-starter-unit-5-tier-42w-x-24d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 18:57:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/foam/foam_tubes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/foam/foam_tubes landed on page that is not a product page.
2026-01-10 18:57:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-washer-66mm-x-13-x-1t-mdl201plnr-6012183>: HTTP status code is not handled or not allowed
2026-01-10 18:57:31 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs landed on page that is not a product page.
2026-01-10 18:57:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-plastex-wheel-5x2-1-roller>: HTTP status code is not handled or not allowed
2026-01-10 18:57:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-plastex-wheel-8x2-12-1-roller>: HTTP status code is not handled or not allowed
2026-01-10 18:57:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clasp-envelopes-10w-x-13l-kraft-500pack>: HTTP status code is not handled or not allowed
2026-01-10 18:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:57:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-seal-bubble-mailers-6-12-12w-x-19l-kraft-25pack>: HTTP status code is not handled or not allowed
2026-01-10 18:57:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-12-x-8-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:57:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clasp-envelopes-10w-x-15l-kraft-500pack>: HTTP status code is not handled or not allowed
2026-01-10 18:57:37 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs landed on page that is not a product page.
2026-01-10 18:57:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simoniz-ultra-line-floor-stripper-5-gallon>: HTTP status code is not handled or not allowed
2026-01-10 18:57:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-18-x-12-double-wall-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 18:57:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700356blu-pegboard-powerwing-display-1675w-x-60h-bl-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 18:57:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-subject-to-static-damage-print-3l-x-2w-redblack-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 18:57:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelite-vented-plastic-shelving-starter-unit-5-tier-72w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 18:57:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 18:57:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premier-colored-pencils-150-assorted-colors-pack>: HTTP status code is not handled or not allowed
2026-01-10 18:57:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-suites-adjustable-footrest-with-microban-protection>: HTTP status code is not handled or not allowed
2026-01-10 18:57:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sani-adjustable-aluminum-tubular-shelf-20-inch-72-inch>: HTTP status code is not handled or not allowed
2026-01-10 18:57:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-heavy-duty-standard-threaded-hex-base-warning-whip-w-o-light-12-x11-yellow-rectangle-flag>: HTTP status code is not handled or not allowed
2026-01-10 18:57:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polystyrene-sheet-24-l-x-12-w-x-1-32-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 18:57:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-hitch-mount-w-threaded-hex-base-and-24-power-cord>: HTTP status code is not handled or not allowed
2026-01-10 18:57:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/610105wht-flat-revolving-display-base-075h-x-5dia-wh-10pack>: HTTP status code is not handled or not allowed
2026-01-10 18:57:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/112739-vert-l-shaped-acrylic-sign-hlr-25w-x-35h-10pack>: HTTP status code is not handled or not allowed
2026-01-10 18:57:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-made-in-america-by-print-8l-x-2w-redwhiteblue-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 18:57:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-epdm-strip-120-l-x-1-w-x-3-4-thick-black-acrylic-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 18:57:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/female-quick-disconnect-base-mount-w-6-pigtail-and-debris-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:57:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700421blk-pinwheel-pegboard-display-wwheels-16w-x-60h-bk-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 18:57:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/server-signature-touch-squeeze-bottle-warmer>: HTTP status code is not handled or not allowed
2026-01-10 18:58:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-magnetic-retractable-belt-barrier-black-mount-red-belt-30-ft-l>: HTTP status code is not handled or not allowed
2026-01-10 18:58:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/server-complete-insulated-mini-bar-w-4-1-9-size-jar-lids-ladles>: HTTP status code is not handled or not allowed
2026-01-10 18:58:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-heavy-duty-quick-disconnect-warning-whip-w-o-light-12-x11-orange-rectangle-flag>: HTTP status code is not handled or not allowed
2026-01-10 18:58:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-x-2-grooved-clevis-pin-18-8-stainless-steel-clpgs-0312-2000>: HTTP status code is not handled or not allowed
2026-01-10 18:58:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-dia-round-letter-paper-labels-with-d-print-fluorescent-yellow-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 18:58:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultem-pei-sheet-48-l-x-12-w-x-3-8-thick-amber>: HTTP status code is not handled or not allowed
2026-01-10 18:58:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guard-dog-low-profile-5-ch-orange-lidblack-base>: HTTP status code is not handled or not allowed
2026-01-10 18:58:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-4-1-2-in-dia-64-inch-h-yellow-blue-tape>: HTTP status code is not handled or not allowed
2026-01-10 18:58:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11128 pages (at 95 pages/min), scraped 4705 items (at 41 items/min)
2026-01-10 18:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:58:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/54-h-nexel-corner-wire-shelving-24-w-x-18-d-796554>: HTTP status code is not handled or not allowed
2026-01-10 18:58:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamondback-ramps-only-for-uhb3035t>: HTTP status code is not handled or not allowed
2026-01-10 18:58:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6016n-ultra-wrist-digital-blood-pressure-monitor>: HTTP status code is not handled or not allowed
2026-01-10 18:58:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/olympic-hex-bar-2-handle>: HTTP status code is not handled or not allowed
2026-01-10 18:58:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-density-foam-roller-18lx6-diameter-round>: HTTP status code is not handled or not allowed
2026-01-10 18:58:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-socket-3-8-drive-9-16-6-point-flex-short>: HTTP status code is not handled or not allowed
2026-01-10 18:58:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/124in-w-x-44in-d-reception-station-with-electric-raceway-cherry-counter-blue-panel>: HTTP status code is not handled or not allowed
2026-01-10 18:58:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b0150s-2-bucket-trap-1-2-in>: HTTP status code is not handled or not allowed
2026-01-10 18:58:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 18:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/towing_accessories/hitch_covers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:58:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-3-8-drive-t40-internal-torx>: HTTP status code is not handled or not allowed
2026-01-10 18:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/towing_accessories/hitch_covers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:58:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-socket-3-8-drive-1-2-6-point-short>: HTTP status code is not handled or not allowed
2026-01-10 18:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:58:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iowa-hitch-cover-4-1-2-x-3-3-8-15076>: HTTP status code is not handled or not allowed
2026-01-10 18:58:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desktop-direct-thermal-labels-4w-x-5l-1-core-4od-white-12pack>: HTTP status code is not handled or not allowed
2026-01-10 18:58:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-bar-60-l-x-3-4-w-x-3-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 18:58:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nhl-tampa-bay-lightning-grill-mat-14250>: HTTP status code is not handled or not allowed
2026-01-10 18:58:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-1-2-drive-6-point-1-1-8-deep>: HTTP status code is not handled or not allowed
2026-01-10 18:58:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/non-hazardous-labels-universal-waste6l-x-6w-purplewhite-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 18:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/towing_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:58:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-sheet-12-l-x-12-w-x-1-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 18:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/towing_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:58:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-office-partition-panel-w-partial-window-and-raceway-48-1-4w-x-101-1-2h-blue-gl>: HTTP status code is not handled or not allowed
2026-01-10 18:58:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 18:58:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-bar-12-l-x-3-w-x-1-4-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 18:58:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moo-tel-calf-nursery-w-doors-26w-x-24l-white>: HTTP status code is not handled or not allowed
2026-01-10 18:58:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leveling-foot-threaded-1800-lbs-capacity-50mm-base-dia-41-50-m8-40-d3-sk>: HTTP status code is not handled or not allowed
2026-01-10 18:58:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bi12632-loaded-gear-cx800-accessory-pouch-tan>: HTTP status code is not handled or not allowed
2026-01-10 18:58:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cb13052-standard-fold-out-cash-box-w-key-lock-1134w-x-914d-x-312h-black-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:58:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mstf647vs-caution-sign-not-a-step-10w-x-7h-adhesive-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 18:58:41 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/towing_accessories> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/towing_accessories landed on page that is not a product page.
2026-01-10 18:58:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mext910va-not-an-exit-sign-10w-x-7h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:58:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/towing_accessories>: HTTP status code is not handled or not allowed
2026-01-10 18:58:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-door-enclosed-recycled-rubber-tackboard-96w-x48h-tan-speckled-w-walnut-frame>: HTTP status code is not handled or not allowed
2026-01-10 18:58:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-w-do-not-inventory-print-2l-x-1-14w-fluorescent-red-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 18:58:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcsp002vs-danger-sign-confined-space-14w-x-10h-adhesive-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 18:58:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-bar-24-l-x-1-1-2-w-x-1-4-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 18:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:58:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/econoline-storage-building-20w-x-12h-x-25l-green-pony-wall>: HTTP status code is not handled or not allowed
2026-01-10 18:58:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-socket-1-2-drive-flex-9-16-6-point-flex-short>: HTTP status code is not handled or not allowed
2026-01-10 18:58:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sds-binder-and-safety-station-2-inch-binder>: HTTP status code is not handled or not allowed
2026-01-10 18:58:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mppa656va-caution-sign-personal-protective-equipment-required-14w-x-10h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:58:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hurricane-mini-360-hand-chain-hoist-1-2t-10-lift>: HTTP status code is not handled or not allowed
2026-01-10 18:58:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mchl224va-danger-sign-diesel-fuel-10w-x-7h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/foam/foam_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:58:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-bench-cabinet-shop-top-2-locking-doors-shelf-42-1-8-w-x-25-13-16-d-x-36-3-8-h>: HTTP status code is not handled or not allowed
2026-01-10 18:58:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spm-1080-mini-accelerator-4-1-2-x-10-120v-50-cord>: HTTP status code is not handled or not allowed
2026-01-10 18:58:58 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 18:58:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6x25-liter-bench-polypropylene-acid-cabinet-16w-x-16-1-2d-x-16h>: HTTP status code is not handled or not allowed
2026-01-10 18:58:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kst814-lockout-6-padlock-capacity-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 18:59:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s153-zebra-thermal-transfer-ribbons-3-12w-x-1476l-waxresin-black-24-rollscase>: HTTP status code is not handled or not allowed
2026-01-10 18:59:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kcc703-padlock-shelf-rack-4-6-padlock-capacity-steel>: HTTP status code is not handled or not allowed
2026-01-10 18:59:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shag-style-diamond-trellis-area-rug-8-ft-x-10-ft-ivory-gray-polyester>: HTTP status code is not handled or not allowed
2026-01-10 18:59:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-budd-wheel-socket-13-16-square-x-1-1-2-hex-3-4-drive>: HTTP status code is not handled or not allowed
2026-01-10 18:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/decor_linens/rugs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:59:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/foam/foam_rolls>: HTTP status code is not handled or not allowed
2026-01-10 18:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_microscopes/digital_microscopes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:59:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30x25-liter-floor-base-cabinet-fully-lined-top-tray-31w-x-20d-x-36-5-8h>: HTTP status code is not handled or not allowed
2026-01-10 18:59:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/starsense-explorer-dx-130az-smartphone-app-enabled-newtonian-reflector-telescope>: HTTP status code is not handled or not allowed
2026-01-10 18:59:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-8-t-general-clamp-assembly-for-tube-pipe-hydraulic-hose>: HTTP status code is not handled or not allowed
2026-01-10 18:59:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-hex-bit-3mm>: HTTP status code is not handled or not allowed
2026-01-10 18:59:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11216 pages (at 88 pages/min), scraped 4740 items (at 35 items/min)
2026-01-10 18:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:59:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clean-cut-fray-resistant-sleeving-3-8-dia-100-black>: HTTP status code is not handled or not allowed
2026-01-10 18:59:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-8-stainless-cushioned-loop-clamp>: HTTP status code is not handled or not allowed
2026-01-10 18:59:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-sheet-24-l-x-12-w-x-3-16-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 18:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/decor_linens already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:59:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-service-bench-20-bin-box-locking-cabinet-and-3-drawers-48-w-x-25-d-x-40-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:59:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_microscopes/digital_microscopes>: HTTP status code is not handled or not allowed
2026-01-10 18:59:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/socket-1-4-drive-t10-internal-torx>: HTTP status code is not handled or not allowed
2026-01-10 18:59:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-8-inches-buckle-for-stainless-steel-100-per-case>: HTTP status code is not handled or not allowed
2026-01-10 18:59:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-enclosed-wire-stockpicker-truck-48-x-18-x-69-800-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 18:59:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 18:59:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-socket-3-8-drive-15mm-6-point-deep>: HTTP status code is not handled or not allowed
2026-01-10 18:59:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x30-4-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 18:59:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/melc135vp-danger-sign-high-voltage-authorized-personnel-only-10w-x-7h-plastic>: HTTP status code is not handled or not allowed
2026-01-10 18:59:25 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/decor_linens> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/decor_linens landed on page that is not a product page.
2026-01-10 18:59:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-x14-x36-1-5-mil-gusseted-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 18:59:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4000-semi-outdoor-led-mass-notification-sign-full-color-power-over-ethernet-4080rgb>: HTTP status code is not handled or not allowed
2026-01-10 18:59:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4000-indoor-led-message-sign-full-color-4080rgb>: HTTP status code is not handled or not allowed
2026-01-10 18:59:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x20-4-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 18:59:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-1-2-drive-6-point-22mm-deep>: HTTP status code is not handled or not allowed
2026-01-10 18:59:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-1-2-drive-6-point-23mm-deep>: HTTP status code is not handled or not allowed
2026-01-10 18:59:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polyester-film-6000-l-x-36-w-x-1-25-thick-clear>: HTTP status code is not handled or not allowed
2026-01-10 18:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_drawers_keyboard_trays already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:59:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-1-4-drive-9mm-deep>: HTTP status code is not handled or not allowed
2026-01-10 18:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 18:59:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jpj-12bhh-12-planerjointer-combo-with-helical-head-cutterhead-3hp-1-phase-230v>: HTTP status code is not handled or not allowed
2026-01-10 18:59:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-bar-12-l-x-1-w-x-1-4-thick-clear-scratch-and-uv-resistant>: HTTP status code is not handled or not allowed
2026-01-10 18:59:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-sheet-48-l-x-48-w-x-3-16-thick-clear-scratch-and-uv-resistant>: HTTP status code is not handled or not allowed
2026-01-10 18:59:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z-line-additional-perforated-steel-shelf-level-with-clips-48-w-x-18-d-x-1-5-16-h>: HTTP status code is not handled or not allowed
2026-01-10 18:59:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-cpvc-sheet-6-l-x-6-w-x-1-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:59:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x3-1-2-x18-1-5-mil-gusseted-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 18:59:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z-line-additional-perforated-steel-shelf-level-with-clips-42-w-x-36-d-x-1-5-16-h>: HTTP status code is not handled or not allowed
2026-01-10 18:59:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-1-2-x-10-7-8-x-3-1-2-lewisbins-divider-box-gray>: HTTP status code is not handled or not allowed
2026-01-10 18:59:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_drawers_keyboard_trays> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_drawers_keyboard_trays landed on page that is not a product page.
2026-01-10 18:59:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock>: HTTP status code is not handled or not allowed
2026-01-10 18:59:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duraflex-woven-high-abrasion-sleeve-286-dia-100-black>: HTTP status code is not handled or not allowed
2026-01-10 18:59:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermashield-aluminized-fiberglass-tube-150-dia-250-silver>: HTTP status code is not handled or not allowed
2026-01-10 18:59:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/malleable-plug-4>: HTTP status code is not handled or not allowed
2026-01-10 18:59:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-sheet-12-l-x-12-w-x-1-2-thick-gray-ps-cpvc-23>: HTTP status code is not handled or not allowed
2026-01-10 18:59:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durawrap-1050-ballistic-nylon-wrap-w-velcro-closure-8-dia-25-black>: HTTP status code is not handled or not allowed
2026-01-10 18:59:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-railing-flange-with-toe-board-adapter-2>: HTTP status code is not handled or not allowed
2026-01-10 18:59:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2x8-1-5-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 18:59:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/li-ion-battery-for-strike-upright-zephyr-backpack--tempest-sweeper-vac-36v-75ah>: HTTP status code is not handled or not allowed
2026-01-10 18:59:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-stitch-janitor-broom-100-corn-26-fill-56>: HTTP status code is not handled or not allowed
2026-01-10 18:59:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/streamlight-46000-portable-scene-light-ii-10-000-lumen-rotating-head-led-rechageable-scene-light>: HTTP status code is not handled or not allowed
2026-01-10 18:59:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-3-panel-corner-room-divider-with-partial-window-36-x-61-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:59:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-3-panel-corner-room-divider-with-partial-window-48-x-61-blue>: HTTP status code is not handled or not allowed
2026-01-10 18:59:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcaw800vs-notice-sign-non-potable-water-14w-x-10h-adhesive-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 18:59:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evoke-glide-e-bike-264-lb-capacity-metallic-greencharcoal>: HTTP status code is not handled or not allowed
2026-01-10 19:00:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acudor-24x24-aluminum-diamond-plate-floor-door-no-hinge>: HTTP status code is not handled or not allowed
2026-01-10 19:00:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jct-1602-benchtop-sand-rammer-24-cfm-800-bpm-90-psi>: HTTP status code is not handled or not allowed
2026-01-10 19:00:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4x18-4-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 19:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5400103-round-file-10-smooth-cut>: HTTP status code is not handled or not allowed
2026-01-10 19:00:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crystallizing-dishes-90x50mm-case-of-18>: HTTP status code is not handled or not allowed
2026-01-10 19:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=5550043-flat-file-4-smooth-cut already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torrent-walk-behind-battery-powered-sweeper-28-cleaning-width>: HTTP status code is not handled or not allowed
2026-01-10 19:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brushless-hepa-backpack-vacuum-kit-with-40v-max-xgt-li-ion-batteries-15-gal-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:00:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3x5-3-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 19:00:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11307 pages (at 91 pages/min), scraped 4778 items (at 38 items/min)
2026-01-10 19:00:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ez-fit-in-counter-lid-dispensers-l2200c>: HTTP status code is not handled or not allowed
2026-01-10 19:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/hvac/air_conditioners_chillers/air_conditioner_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rs22-3-semi-automatic-random-side-drive-case-sealer-with-3-tape-head>: HTTP status code is not handled or not allowed
2026-01-10 19:00:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freestanding-2-panel-corner-room-divider-24-x-60-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:00:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:00:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-2-panel-corner-room-divider-36-x-73-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:00:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/searchResult?q=5550043-flat-file-4-smooth-cut>: HTTP status code is not handled or not allowed
2026-01-10 19:00:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:00:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-2-panel-corner-room-divider-48-x-73-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:00:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-wash-bottle-carrier-holds-250-500ml-8-16oz-bottles-11-x-7-x-8>: HTTP status code is not handled or not allowed
2026-01-10 19:00:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/hvac/air_conditioners_chillers/air_conditioner_accessories>: HTTP status code is not handled or not allowed
2026-01-10 19:00:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/saf-t-grip-cutting-boards-cbg121812bl>: HTTP status code is not handled or not allowed
2026-01-10 19:00:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prison-bench-4-foot-solid-steel-seating-without-backrest-black>: HTTP status code is not handled or not allowed
2026-01-10 19:00:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardair-ultra-xtra-thrust-24-alum-ext-alloy-nozzle-long-trigger>: HTTP status code is not handled or not allowed
2026-01-10 19:00:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-2-x-24-kra-mailing-tubes-with-caps-case>: HTTP status code is not handled or not allowed
2026-01-10 19:00:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reach-hand-cleaner-gallon-bottle-4-case-1049220>: HTTP status code is not handled or not allowed
2026-01-10 19:00:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pn-30005-privacy-netting-wreinforced-hem-68-x-150-green>: HTTP status code is not handled or not allowed
2026-01-10 19:00:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x-36-kra-tubes-with-caps-case>: HTTP status code is not handled or not allowed
2026-01-10 19:00:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-inward-swing-partition-door-25-5-8in-w-x-58in-h-almond>: HTTP status code is not handled or not allowed
2026-01-10 19:00:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-polypropylene-instrument-tray-with-cover-6-x-3-3-4-x-2-1-4>: HTTP status code is not handled or not allowed
2026-01-10 19:00:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelate-wire-shelving-add-on-a30367ep-36w-x-30d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 19:00:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/39-51-degree-api-astm-5h-hydrometer>: HTTP status code is not handled or not allowed
2026-01-10 19:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_thermometers_hydrometers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-rod-60-l-x-1-5-8-dia-white>: HTTP status code is not handled or not allowed
2026-01-10 19:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-1503-insulation-tester-0-1-to-2000m>: HTTP status code is not handled or not allowed
2026-01-10 19:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_thermometers_hydrometers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-1550c-insulation-resistance-tester-5-kv-w-measurement-storage-pc-interface>: HTTP status code is not handled or not allowed
2026-01-10 19:00:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/non-perforated-air-bubble-roll-12w-x-250l-x-12-bubble-clear-4pack>: HTTP status code is not handled or not allowed
2026-01-10 19:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/testing_inspection_instruments/electrical_power_testing/electrical_power_testing_parts_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-tl223-1-suregrip-electrical-test-lead-set>: HTTP status code is not handled or not allowed
2026-01-10 19:00:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-hydraulic-jack-65-ton-65-1h>: HTTP status code is not handled or not allowed
2026-01-10 19:00:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pennsylvania-7600-series-hdhigh-resolution-db-capable-counting-scale-50-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3500-3999-inventory-tag-2-part-carbonless>: HTTP status code is not handled or not allowed
2026-01-10 19:00:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-ac175-threaded-alligator-clip-set>: HTTP status code is not handled or not allowed
2026-01-10 19:00:45 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_thermometers_hydrometers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_thermometers_hydrometers landed on page that is not a product page.
2026-01-10 19:00:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:00:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_thermometers_hydrometers>: HTTP status code is not handled or not allowed
2026-01-10 19:00:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eemax-electric-mini-tank-1-gallon-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:00:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/testing_inspection_instruments/electrical_power_testing/electrical_power_testing_parts_accessories>: HTTP status code is not handled or not allowed
2026-01-10 19:00:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crinkle-paper-40-lbs-forest-greed>: HTTP status code is not handled or not allowed
2026-01-10 19:00:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-c280-so-carrying-case-polyester-black-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:00:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7500-7999-wired-inventory-tag-3-part-carbonless>: HTTP status code is not handled or not allowed
2026-01-10 19:00:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/control-valve-740>: HTTP status code is not handled or not allowed
2026-01-10 19:00:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-tape-for-protective-labeling-system-36yd-length-1-width-1-core-3pk>: HTTP status code is not handled or not allowed
2026-01-10 19:00:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colony-counter-black-replacement-tip-marker>: HTTP status code is not handled or not allowed
2026-01-10 19:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:00:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-2w-20l-2-ply-eye-eye-poly-web-sling-flat-eyes>: HTTP status code is not handled or not allowed
2026-01-10 19:00:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/science-lab-table-black-laminate-top-ash-wood-frame-30wx72lx30h>: HTTP status code is not handled or not allowed
2026-01-10 19:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:01:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coated-lead-shield-8-1-2-x-3-x-6>: HTTP status code is not handled or not allowed
2026-01-10 19:01:01 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock landed on page that is not a product page.
2026-01-10 19:01:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-rod-96-l-x-1-1-2-dia-black>: HTTP status code is not handled or not allowed
2026-01-10 19:01:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-add-on-18245gz-24w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:01:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-vci-paper-35-lbs-12w-x-200-yd-kraft-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:01:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dispensing-drop-60ml-2oz-polyethylene-bottles-18mm-closure-12pk>: HTTP status code is not handled or not allowed
2026-01-10 19:01:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-3-4-x-2-3-8-5-red-strung-tag>: HTTP status code is not handled or not allowed
2026-01-10 19:01:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-in-h-lift-out-guard-rail-corner-post-double-rail>: HTTP status code is not handled or not allowed
2026-01-10 19:01:07 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock landed on page that is not a product page.
2026-01-10 19:01:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlocking-storage-cabinet-11-3-4w-11-3-8d-x-11h-10-blue-drawers>: HTTP status code is not handled or not allowed
2026-01-10 19:01:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:01:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11397 pages (at 90 pages/min), scraped 4813 items (at 35 items/min)
2026-01-10 19:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:01:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-add-on-14546gz-54w-x-14d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 19:01:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-tube-24-l-x-1-1-2-id-x-1-3-4-od-white>: HTTP status code is not handled or not allowed
2026-01-10 19:01:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-1-4-x-3-1-8-8-pink-wired-tag>: HTTP status code is not handled or not allowed
2026-01-10 19:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:01:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:01:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roundup-1-1-4w-14l-endless-poly-roundsling-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:01:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-tube-24-l-x-3-16-id-x-3-8-od-white>: HTTP status code is not handled or not allowed
2026-01-10 19:01:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-14366gz-36w-x-14d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 19:01:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-graphite-sheet-6-l-x-6-w-x-1-4-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 19:01:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:01:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kendall-howard-advanced-classroom-training-table-caster-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/bins_totes_containers/bins/cubby_bins_trays already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:01:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-aker-ceiling-fan-with-light-59302-matte-black>: HTTP status code is not handled or not allowed
2026-01-10 19:01:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:01:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-plastic-gray-2-shelf-tray-service-utility-38x17-5-cart-5-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:01:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wooden-wet-floor-sign-walnut-finish-with-nickel-plate>: HTTP status code is not handled or not allowed
2026-01-10 19:01:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-rack-24x36x60-with-88-gray-drawers>: HTTP status code is not handled or not allowed
2026-01-10 19:01:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-diaphragm-pump-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:01:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-piece-rectangle-outdoor-dining-set-gray-with-white-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_thermometers_hydrometers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:01:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-astm-like-liquid-in-glass-thermometer-1f-partial-immersion-76mm-0-to-302f>: HTTP status code is not handled or not allowed
2026-01-10 19:01:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tempco-hd-cartridge-18od-2l-120v-100w-175>: HTTP status code is not handled or not allowed
2026-01-10 19:01:31 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/bins_totes_containers/bins/cubby_bins_trays> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/bins_totes_containers/bins/cubby_bins_trays landed on page that is not a product page.
2026-01-10 19:01:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tv-cctv-monitor-wall-mount-bracket-for-monitor-9in-14in>: HTTP status code is not handled or not allowed
2026-01-10 19:01:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-in-glass-oven-thermometer-0-to-200c-organic-liquid-fill-125mm-immersion>: HTTP status code is not handled or not allowed
2026-01-10 19:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:01:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tempco-channel-strip-120v-t3-5-34l-300w>: HTTP status code is not handled or not allowed
2026-01-10 19:01:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-rod-72-l-x-7-16-dia-white>: HTTP status code is not handled or not allowed
2026-01-10 19:01:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indoor-laser-bird-repeller-bx-laser-in>: HTTP status code is not handled or not allowed
2026-01-10 19:01:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-12-l-x-5-w-x-1-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 19:01:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_thermometers_hydrometers>: HTTP status code is not handled or not allowed
2026-01-10 19:01:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-x-5-clear-face-invoice-enclosed-panel-face>: HTTP status code is not handled or not allowed
2026-01-10 19:01:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contemporary-modular-lounge-loveseat-leather-black-hercules-lacey-series>: HTTP status code is not handled or not allowed
2026-01-10 19:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:01:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/267300006-hydrantutility-marker-7-long-with-port-mount-bracket-with-spring>: HTTP status code is not handled or not allowed
2026-01-10 19:01:44 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_rod_stock landed on page that is not a product page.
2026-01-10 19:01:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-bar-36-l-x-4-w-x-1-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 19:01:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-armored-liquid-in-glass-thermometer-20-to-150c-76mm-immersion-organic-liquid-fill>: HTTP status code is not handled or not allowed
2026-01-10 19:01:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mro-industrial-enamel-20-oz-omaha-orange-6-cans-case-620-1450>: HTTP status code is not handled or not allowed
2026-01-10 19:01:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simplehuman-174-profile-open-can-2-3-5-gallon-brushed-ss>: HTTP status code is not handled or not allowed
2026-01-10 19:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:01:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x12-4-mil-white-block-reclosable-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 19:01:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hplc-reservoir-secondary-container-10-liters>: HTTP status code is not handled or not allowed
2026-01-10 19:01:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-bar-24-l-x-1-1-2-w-x-1-1-2-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 19:01:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lab-companion-amber-polycarbonate-round-style-vacuum-desiccator-10-liter>: HTTP status code is not handled or not allowed
2026-01-10 19:01:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/individually-calibrated-19-31-degree-api-astm-3h-hydrometer>: HTTP status code is not handled or not allowed
2026-01-10 19:01:54 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 19:01:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x8-4-mil-double-track-reclosable-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 19:01:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-astm-like-liquid-in-glass-thermometer-37c-solvents-distillation-2-to-52c>: HTTP status code is not handled or not allowed
2026-01-10 19:01:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/52h15hdw50n-jafline-hd-double-jacket-fire-hose-1-12-x-50-ft-400-psi-white>: HTTP status code is not handled or not allowed
2026-01-10 19:01:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gn5632-aluminum-thandle-wthreaded-stud-mm-diameter-67mm-length-m8x125>: HTTP status code is not handled or not allowed
2026-01-10 19:01:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:01:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worktop-refrigerator-freezer-32-base-model-46w-wtr46a>: HTTP status code is not handled or not allowed
2026-01-10 19:02:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyethylene-dispensing-jug-20-liters-5-gallons-polyethylene-spigot>: HTTP status code is not handled or not allowed
2026-01-10 19:02:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-calibrated-liquid-in-glass-thermometer-1-to-51c-total-immersion>: HTTP status code is not handled or not allowed
2026-01-10 19:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/belt_stanchions already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:02:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-jaque-plastic-lab-jack>: HTTP status code is not handled or not allowed
2026-01-10 19:02:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-wall-mount-wire-shelving-60w-x-24d-x-34h-2-shelf-add-on-poly-green>: HTTP status code is not handled or not allowed
2026-01-10 19:02:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-wire-shelf-stem-caster-truck-2-with-brakes-nexelon-18-w-x-48-l-x-69-h>: HTTP status code is not handled or not allowed
2026-01-10 19:02:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-sheet-48-l-x-24-w-x-1-1-2-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 19:02:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cr-polyurethane-gray-grip-gloves-with-hppe-glass-liner-gray-palm-fingers-s-1-dz>: HTTP status code is not handled or not allowed
2026-01-10 19:02:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-60-basis-weight-kra-paper>: HTTP status code is not handled or not allowed
2026-01-10 19:02:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11487 pages (at 90 pages/min), scraped 4848 items (at 35 items/min)
2026-01-10 19:02:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-wall-mount-wire-shelving-54w-x-18d-x-14h-1-shelf-starter-poly-green>: HTTP status code is not handled or not allowed
2026-01-10 19:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:02:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-12-l-x-1-w-x-1-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 19:02:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-48-l-x-4-w-x-2-3-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 19:02:12 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/belt_stanchions> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/belt_stanchions landed on page that is not a product page.
2026-01-10 19:02:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-wall-mount-wire-shelving-72w-x-24d-x-63h-4-shelf-starter-poly-green>: HTTP status code is not handled or not allowed
2026-01-10 19:02:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-24-6-drawer-2-cabinets-maple>: HTTP status code is not handled or not allowed
2026-01-10 19:02:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glass-door-back-bar-refrigerator-bb-g-79w-bb78g>: HTTP status code is not handled or not allowed
2026-01-10 19:02:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bumpon-protective-product-sj5202-hexagon-0-433-w-x-0-063-l-lt-brown-pkg-of-3000>: HTTP status code is not handled or not allowed
2026-01-10 19:02:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-591ml-standard-stem-funnels-12pk>: HTTP status code is not handled or not allowed
2026-01-10 19:02:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-pfa-safety-coated-liquid-in-glass-thermometer-10-to-150c-total-immersion>: HTTP status code is not handled or not allowed
2026-01-10 19:02:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:02:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-x-8ft-nyl-glo-us-flag-with-embroidered-stars-lock-stitching>: HTTP status code is not handled or not allowed
2026-01-10 19:02:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-recess-mount-ceiling-heater-240v-3000w>: HTTP status code is not handled or not allowed
2026-01-10 19:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:02:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/geg-50es-spherical-plain-bearing-metric-extended-inner-ring>: HTTP status code is not handled or not allowed
2026-01-10 19:02:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hitch-n-plow-non-pto-driven-3-point-tractor-implement>: HTTP status code is not handled or not allowed
2026-01-10 19:02:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-sheet-48-l-x-24-w-x-3-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 19:02:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stacked-chair-dolly-for-narrow-chairs>: HTTP status code is not handled or not allowed
2026-01-10 19:02:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-5-tier-30w-x-21d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:02:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-carry-all-tractor-attachment-1000-lb-capacity-cat-1>: HTTP status code is not handled or not allowed
2026-01-10 19:02:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-5-tier-42w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 19:02:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/01-016-emergency-food-supply-favorites-16-servings>: HTTP status code is not handled or not allowed
2026-01-10 19:02:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ge-180es-spherical-plain-bearing-metric>: HTTP status code is not handled or not allowed
2026-01-10 19:02:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotary-separatory-funnel-rack-6-places-fits-500-1000cc-funnels>: HTTP status code is not handled or not allowed
2026-01-10 19:02:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:02:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ge-45te-2rs-spherical-plain-bearing-metric-high-capacity-sealed>: HTTP status code is not handled or not allowed
2026-01-10 19:02:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-8200-r-wide-body-duplex-receptacle-straight-blade-hospital-grade-self-grounding-red>: HTTP status code is not handled or not allowed
2026-01-10 19:02:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40-41440-entree-and-breakfast-bucket-6-months-2-servings-day-1440-servings>: HTTP status code is not handled or not allowed
2026-01-10 19:02:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-sheet-48-l-x-24-w-x-3-8-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 19:02:34 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 19:02:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fixed-straight-3-shelf-bookcase-36wx15dx35h>: HTTP status code is not handled or not allowed
2026-01-10 19:02:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gezm-108es-2rs-spherical-plain-bearing-inch-extended-inner-ring-sealed>: HTTP status code is not handled or not allowed
2026-01-10 19:02:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1610-240-surface-mount-spike-system-end-cap-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:02:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-36-l-x-1-w-x-1-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 19:02:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-wing-clip-for-pegboard-and-slatwall-12l-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:02:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-1221-st-20-amp-120-277-volt-toggle-single-pole-ac-quiet-switch-industrial-grade-grounding-light-almond>: HTTP status code is not handled or not allowed
2026-01-10 19:02:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/briskheat-silicone-rubber-5-gallon-plastic-pail-heater-120v>: HTTP status code is not handled or not allowed
2026-01-10 19:02:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6826-btu-fan-forced-wall-heaters-w-double-pole-thermostat-208v>: HTTP status code is not handled or not allowed
2026-01-10 19:02:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-48w-x-36d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 19:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:02:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/70-lb-freestanding-base-black>: HTTP status code is not handled or not allowed
2026-01-10 19:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:02:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-42120-1-single-phase-branch-panel-mount-surge-protection-device>: HTTP status code is not handled or not allowed
2026-01-10 19:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/lockers/bulk_storage_lockers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:02:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ge-30es-spherical-plain-bearing-metric>: HTTP status code is not handled or not allowed
2026-01-10 19:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:02:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/geh-17es-spherical-plain-bearing-metric-heavy-series>: HTTP status code is not handled or not allowed
2026-01-10 19:02:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-section-folding-storage>: HTTP status code is not handled or not allowed
2026-01-10 19:02:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-rod-12-l-x-1-1-8-dia-off-white-glass-filled>: HTTP status code is not handled or not allowed
2026-01-10 19:02:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-cup-euro-style-coffee-maker-cc123>: HTTP status code is not handled or not allowed
2026-01-10 19:02:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-neoprene-roll-480-l-x-16-w-x-1-2-thick-white-food-60a>: HTTP status code is not handled or not allowed
2026-01-10 19:02:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-2000-small-outdoor-waterproof-case-w-o-foam-insert-10-3-4-l-x-8-1-2-w-x-6-1-2h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:02:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 19:02:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:02:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/lockers/bulk_storage_lockers>: HTTP status code is not handled or not allowed
2026-01-10 19:02:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:03:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mounting-kit-with-18-w-louver-36-w-pegboard-72-w-workbench-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:03:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tz-tape-cartridge-p-touch-labelers-flexible-tape-black-on-white-1-2w>: HTTP status code is not handled or not allowed
2026-01-10 19:03:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plano-stowaway-24-fixed-compartment-box-14-1-4-w-x-2-1-4-d-x-11-1-2-h-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:03:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9600-50-adapter-reducer-16-inch-to-8-inch-for-models-9515-and-9517>: HTTP status code is not handled or not allowed
2026-01-10 19:03:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-tile-top-antifatigue-mat-7-8-thick-24x36-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 19:03:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9537-25-8-inch-axial-dc-metal-com-pax-ial-blower-w-canister-25-ducting-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_storage_bench_protection/laboratory_bench_racks_stands already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:03:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9535-12l-12-inch-ac-air-bag-blower-w-25-ducting>: HTTP status code is not handled or not allowed
2026-01-10 19:03:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-36-l-x-1-1-2-w-x-1-2-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 19:03:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-plastic-binding-combs-letter-size-90-sheet-capacity-1-2-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:03:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-5-tier-30w-x-24d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 19:03:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11579 pages (at 92 pages/min), scraped 4879 items (at 31 items/min)
2026-01-10 19:03:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-underbed-truck-box-18x18x36-black-1732305>: HTTP status code is not handled or not allowed
2026-01-10 19:03:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers>: HTTP status code is not handled or not allowed
2026-01-10 19:03:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-304-stainless-steel-locker-18w-x-18d-x-78h-double-tier-1-wide-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:03:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twin-pocket-leatherette-grained-portfolios-royal-blue-25-box>: HTTP status code is not handled or not allowed
2026-01-10 19:03:15 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/lab_storage_bench_protection/laboratory_bench_racks_stands> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/lab_storage_bench_protection/laboratory_bench_racks_stands landed on page that is not a product page.
2026-01-10 19:03:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-54w-x-21d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:03:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-30w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:03:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-heavy-duty-classic-duratough-additional-shelf-36w-x-24d>: HTTP status code is not handled or not allowed
2026-01-10 19:03:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/butterfly-valve-lockout-red-7605>: HTTP status code is not handled or not allowed
2026-01-10 19:03:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-piece-steel-small-ball-valve-lockout-7273>: HTTP status code is not handled or not allowed
2026-01-10 19:03:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/competitor-ventilated-three-tier-locker-adder-1-wide-12w-x-12d-x-24h-unassembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:03:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-valve-lockout-2-inch-to-8-inch-diameter-7251>: HTTP status code is not handled or not allowed
2026-01-10 19:03:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lk5000cr-everyday-pullout-kitchen-faucet-chrome-single-lever-handle>: HTTP status code is not handled or not allowed
2026-01-10 19:03:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lkwobg1617ss-bottom-grid-ss-16316lx141116w>: HTTP status code is not handled or not allowed
2026-01-10 19:03:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-roll-720-l-x-12-w-x-3-32-thick-white-food-60a>: HTTP status code is not handled or not allowed
2026-01-10 19:03:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-teflon-fep-lab-spoon-and-spatula-9-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/highlighters_markers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:03:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/competitor-ventilated-three-tier-locker-3-wide-12w-x-18d-x-24h-assembled-blue-frost>: HTTP status code is not handled or not allowed
2026-01-10 19:03:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-roll-600-l-x-12-w-x-1-16-thick-black-ultra-strength-50a>: HTTP status code is not handled or not allowed
2026-01-10 19:03:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/201005a-klp-guard-locking-switch-std-actstd-release-110v-12npt-pe>: HTTP status code is not handled or not allowed
2026-01-10 19:03:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/notch-hook-semi-gloss-white>: HTTP status code is not handled or not allowed
2026-01-10 19:03:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lcd43909blk-full-motion-tv-wall-mount-for-32-60-monitors-blacks>: HTTP status code is not handled or not allowed
2026-01-10 19:03:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-roll-720-l-x-36-w-x-3-8-thick-black-high-strength-80a-acrylic-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 19:03:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-double-tier-locker-starter-1-wide-12w-x-18d-x-36h-unassembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:03:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/116015-rpr-magnetic-non-contact-switch-10m-2nc-1no>: HTTP status code is not handled or not allowed
2026-01-10 19:03:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/highlighters_markers>: HTTP status code is not handled or not allowed
2026-01-10 19:03:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-abs-sheet-24-l-x-24-w-x-3-8-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 19:03:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-30-square-edge-work-bench-shop-top-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:03:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-x-48-melamine-shelf-white>: HTTP status code is not handled or not allowed
2026-01-10 19:03:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-sheet-36-l-x-12-w-x-1-32-thick-black-high-strength-80a-acrylic-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 19:03:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/232024-a-esl-sslp-e-stop-switch-wled-2nc-2no-ss>: HTTP status code is not handled or not allowed
2026-01-10 19:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_storage_bench_protection/laboratory_bench_racks_stands already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:03:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-polypropylene-instrument-tray-with-cover-11-x-6-x-5>: HTTP status code is not handled or not allowed
2026-01-10 19:03:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/142002-gls-rope-pull-switch-2nc-1no-12npt-die-cast>: HTTP status code is not handled or not allowed
2026-01-10 19:03:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-silicone-sheet-36-l-x-36-w-x-3-8-thick-red-food-70a-high-temp-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 19:03:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tissue-culture-flask-rack-12-places-for-75ml-flasks>: HTTP status code is not handled or not allowed
2026-01-10 19:03:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-double-tier-locker-3-wide-15w-x-18d-x-36h-assembled-almond>: HTTP status code is not handled or not allowed
2026-01-10 19:03:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-sand-urn-5-1-2-lb>: HTTP status code is not handled or not allowed
2026-01-10 19:03:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-t-shaped-tubing-connectors-for-3-8-tubing-polypropylene-12pk>: HTTP status code is not handled or not allowed
2026-01-10 19:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:03:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-metal-latch-and-1-spacer-fg3964l30000>: HTTP status code is not handled or not allowed
2026-01-10 19:03:53 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/lab_storage_bench_protection/laboratory_bench_racks_stands> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/lab_storage_bench_protection/laboratory_bench_racks_stands landed on page that is not a product page.
2026-01-10 19:03:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seq-dual-speed-electric-chain-hoist-1-ton-10-lift-17-3-9-ft-min-115v>: HTTP status code is not handled or not allowed
2026-01-10 19:03:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seq-dual-speed-electric-chain-hoist-1-2-ton-20-lift-25-4-2-ft-min-230v>: HTTP status code is not handled or not allowed
2026-01-10 19:03:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-strip-120-l-x-4-w-x-1-16-thick-black-high-strength-80a>: HTTP status code is not handled or not allowed
2026-01-10 19:03:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-baby-changing-station-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:03:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stirrer-blade-teflon-2-1-2-for-500ml-flasks>: HTTP status code is not handled or not allowed
2026-01-10 19:03:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-polyfoil-wrap-4-x-4-100pk>: HTTP status code is not handled or not allowed
2026-01-10 19:04:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solvent-base-street-utility-marking-paint-20-oz-utility-yellow-20-978-12-case>: HTTP status code is not handled or not allowed
2026-01-10 19:04:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-roll-2880-l-x-36-w-x-1-16-thick-black-high-strength-80a-acrylic-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 19:04:02 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls landed on page that is not a product page.
2026-01-10 19:04:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-thumb-screw-w-shoulder-m4-x-0-7-13mm-thread-11-1mm-head-dia-stainless-pkg-of-5>: HTTP status code is not handled or not allowed
2026-01-10 19:04:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterbase-street-utility-marking-paint-20-oz-orange-fluorescent-20-657-12-case>: HTTP status code is not handled or not allowed
2026-01-10 19:04:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-single-tier-locker-2-wide-12w-x-12d-x-72h-assembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:04:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/core-cl-suture-procedure-cart-with-locking-sliding-door-white-withalmond-beige>: HTTP status code is not handled or not allowed
2026-01-10 19:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:04:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/core-dx-storage-cart-with-security-railed-top-and-sliding-door-white-with-global-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:04:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-double-tier-locker-1-wide-12w-x-15d-x-36h-assembled-almond>: HTTP status code is not handled or not allowed
2026-01-10 19:04:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11673 pages (at 94 pages/min), scraped 4919 items (at 40 items/min)
2026-01-10 19:04:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/additional-level-96x36-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:04:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/trustat-b80-16312-vinyl-mat-with-ground-30-d-x-60-w-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:04:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-roll-8640-l-x-36-w-x-3-32-thick-black-high-strength-90a>: HTTP status code is not handled or not allowed
2026-01-10 19:04:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gasket-cutter-kit-ax6010-style-1-cap-to-13>: HTTP status code is not handled or not allowed
2026-01-10 19:04:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suit-hanger-with-bar-flocked-velvet-pink>: HTTP status code is not handled or not allowed
2026-01-10 19:04:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/additional-level-60x36-steel-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:04:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grab-and-go-low-profile-open-display-merchandiser-rear-loading-manual-shutter-41x36x65>: HTTP status code is not handled or not allowed
2026-01-10 19:04:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-94dv2r-n5-division-2-xenon-strobe-red-120v-ac>: HTTP status code is not handled or not allowed
2026-01-10 19:04:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_sheets>: HTTP status code is not handled or not allowed
2026-01-10 19:04:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-270ledmr120a-smd-multi-mode-led-module-and-light-source-red-120v-ac>: HTTP status code is not handled or not allowed
2026-01-10 19:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:04:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mount-anywhere-basket-12-12-8-w>: HTTP status code is not handled or not allowed
2026-01-10 19:04:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mount-anywhere-basket-24-6-8-w>: HTTP status code is not handled or not allowed
2026-01-10 19:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:04:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-netting-three-bay-14>: HTTP status code is not handled or not allowed
2026-01-10 19:04:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-248ledmy120a-48-mm-led-stacklight-module-yellow-120v-ac>: HTTP status code is not handled or not allowed
2026-01-10 19:04:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-sheet-36-l-x-36-w-x-3-8-thick-black-high-strength-90a>: HTTP status code is not handled or not allowed
2026-01-10 19:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/die_cut_labels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:04:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-netting-two-bay-23>: HTTP status code is not handled or not allowed
2026-01-10 19:04:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-roll-1440-l-x-36-w-x-3-16-thick-black-high-strength-80a>: HTTP status code is not handled or not allowed
2026-01-10 19:04:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30441-vacuum-hose-adapter-1id-to-1-14id-1-pkg-qty>: HTTP status code is not handled or not allowed
2026-01-10 19:04:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b0277-orbit-shaft-balancer-5-x-316-orbit-1-pkg-qty>: HTTP status code is not handled or not allowed
2026-01-10 19:04:27 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_tube_stock landed on page that is not a product page.
2026-01-10 19:04:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/06578-bearing-retainer-1-pkg-qty>: HTTP status code is not handled or not allowed
2026-01-10 19:04:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/rubber/rubber_rolls>: HTTP status code is not handled or not allowed
2026-01-10 19:04:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/briggs-stratton-44s977-0032-g1-gas-engine-professional-v-twin-vertical-shaft-1-crank-shaft>: HTTP status code is not handled or not allowed
2026-01-10 19:04:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/174-m-49-494-gn-b-494-color-polyester-labels-1-h-x-1-w-green-white-260-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:04:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/174-nyl-red-76st-kd-safekey-lockout-padlock-nylon-3-steel-shackle-keyed-different>: HTTP status code is not handled or not allowed
2026-01-10 19:04:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/die_cut_labels>: HTTP status code is not handled or not allowed
2026-01-10 19:04:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indigo-nxt-half-cube-ice-machine-w-luminice-22-wide-460-lbs-24-hrs-prod-water-cooled>: HTTP status code is not handled or not allowed
2026-01-10 19:04:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/draft-inducer-blower-3200-rpm-115v-oao-1-6-fl-amps>: HTTP status code is not handled or not allowed
2026-01-10 19:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/label_tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:04:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30648-o-ring-4-mm-x-10-mm-1-pkg-qty>: HTTP status code is not handled or not allowed
2026-01-10 19:04:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cl3515-2-hp-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:04:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cswdm3538-5-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/die_cut_labels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:04:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/174-cpt-grn-25pl-ka6pk-safekey-lockout-padlock-nylon-1-plastic-shackle-keyed-alike>: HTTP status code is not handled or not allowed
2026-01-10 19:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:04:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/174-150455-prop-65-regulatory-sign-restaurant-14-x-10-polyester-black-on-white>: HTTP status code is not handled or not allowed
2026-01-10 19:04:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-hinged-top-basket-truck-10-bu-gray-vinyl-wood-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 19:04:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-frame-motor-1-500-hp-1100-rpm-120v-oao-c-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/hvac_electric_motors/oem_replacement_fan_blower_motors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:04:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-125xbrmg24d-125xbr-xtra-brite-led-multi-mode-green-24-vdc-0215-amps>: HTTP status code is not handled or not allowed
2026-01-10 19:04:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/circulator-pump-motor-1-4-hp-1725-rpm-115v-odp-60-hertz>: HTTP status code is not handled or not allowed
2026-01-10 19:04:46 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/label_tapes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/label_tapes landed on page that is not a product page.
2026-01-10 19:04:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/circulator-pump-motor-1-6-hp-1725-rpm-115v-odp-48y-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:04:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-270ledb240v-led-bulb-blue-240v>: HTTP status code is not handled or not allowed
2026-01-10 19:04:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/die_cut_labels>: HTTP status code is not handled or not allowed
2026-01-10 19:04:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs>: HTTP status code is not handled or not allowed
2026-01-10 19:04:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-boltless-shelving-48-inch-w-x-24-inch-d-x-84-inch-h-3-levels-add-on-w-ez-decking-black>: HTTP status code is not handled or not allowed
2026-01-10 19:04:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-58a-n5-100wh-rotating-beacon-100wh-amber-120v-ac>: HTTP status code is not handled or not allowed
2026-01-10 19:04:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/hvac_electric_motors/oem_replacement_fan_blower_motors>: HTTP status code is not handled or not allowed
2026-01-10 19:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/sockets_bits/socket_sets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:04:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexible-duct-25-ft-length-of-12-inch-diameter-indoor-outdoor>: HTTP status code is not handled or not allowed
2026-01-10 19:04:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/draft-inducer-blower-3000-rpm-115v-oao-1-43-fl-amps>: HTTP status code is not handled or not allowed
2026-01-10 19:04:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unit-heater-motor-1-3-hp-1140-rpm-115-208-230v-teao-f48y-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:04:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-inch-v-jaw-dipped-handle-tongue-groove-pliers>: HTTP status code is not handled or not allowed
2026-01-10 19:05:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laptop-backpack-locker-45w-x-18d-x-78h-4-tier-3-wide-711-platinum-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:05:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rapidguard-2-lift-off-welded-wire-panel-3-w-x-8-h-panel>: HTTP status code is not handled or not allowed
2026-01-10 19:05:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metromax-4-fivetier-stem-caster-cart-solid-bottom-shelf-18-x-36-x-79-516>: HTTP status code is not handled or not allowed
2026-01-10 19:05:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-shift-cabinet-with-6-drawers-48-w-x-24-d-x-75-h-beige>: HTTP status code is not handled or not allowed
2026-01-10 19:05:05 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/sockets_bits/socket_sets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/sockets_bits/socket_sets landed on page that is not a product page.
2026-01-10 19:05:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-single-phase-tefc-motor-1-hp-1725-rpm-115-208-230v-tefc-56-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:05:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-shift-industrial-cabinet-36-w-x-24-d-x-75-h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:05:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-button-pendant-30-power-cord-for-ssc-series-electronic-hoists>: HTTP status code is not handled or not allowed
2026-01-10 19:05:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11763 pages (at 90 pages/min), scraped 4951 items (at 32 items/min)
2026-01-10 19:05:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unit-heater-motor-1-4-hp-1075-rpm-115v-teao>: HTTP status code is not handled or not allowed
2026-01-10 19:05:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-and-blower-1-1-2-hp-1725-rpm-208-230-460v-odp>: HTTP status code is not handled or not allowed
2026-01-10 19:05:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/watercolor-radiant-white-inkjet-paper-13in-x-19in-white-20-sheets-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:05:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-classic-crest-stationery-baronial-ivory-8-1-2in-x-11in-24-lb-500-sheets-ream>: HTTP status code is not handled or not allowed
2026-01-10 19:05:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/revolution-nevertear-paper-white-8-mil-8-1-2in-x-11in-500-sheets-ream>: HTTP status code is not handled or not allowed
2026-01-10 19:05:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sparco-4-digit-tally-counter-w-finger-ring>: HTTP status code is not handled or not allowed
2026-01-10 19:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/paper_stationery/photo_presentation_paper already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:05:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cdp3443-0-75-hp-2500-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:05:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-rivet-boltless-shelving-48-inch-w-x-24-inch-d-x-84-inch-h-6-levels-add-on-w-o-decking-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:05:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transformer-cooling-fan-motor-1-4-hp-1725-rpm-208-230v-teao>: HTTP status code is not handled or not allowed
2026-01-10 19:05:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-elbow-8mm-tube-x-3-8-bspp-8-9-l>: HTTP status code is not handled or not allowed
2026-01-10 19:05:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pre-configured-6x8-partitioned-office-72-h-starter-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:05:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-shift-cabinet-with-6-drawers-48-w-x-24-d-x-75-h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:05:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/farm-duty-milk-pump-motor-1-hp-3450-rpm-208-230v-tenv-l56hcz-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:05:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pre-configured-8x8-partitioned-office-60-h-starter-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:05:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-uniform-cabinet-with-7-drawers-36-w-x-24-d-x-75-h-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:05:26 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/paper_stationery/photo_presentation_paper> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/paper_stationery/photo_presentation_paper landed on page that is not a product page.
2026-01-10 19:05:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s32000-dp4-replacement-crown-black-for-standard-face-shields>: HTTP status code is not handled or not allowed
2026-01-10 19:05:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-polymer-shelf-with-grid-mat-54-w-x-18-d>: HTTP status code is not handled or not allowed
2026-01-10 19:05:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-oem-replacement-motor-1-8-hp-1650-rpm-200-230v-teao>: HTTP status code is not handled or not allowed
2026-01-10 19:05:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclaimed-rags-white-turkish-twl-25-lbs-99211>: HTTP status code is not handled or not allowed
2026-01-10 19:05:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cem3584t-1-5-hp-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:05:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-straight-male-3-8-tube-x-1-2-nptf-1-1-3-l>: HTTP status code is not handled or not allowed
2026-01-10 19:05:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-aluminum-foil-rolls-3>: HTTP status code is not handled or not allowed
2026-01-10 19:05:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-straight-male-14mm-tube-x-1-2-swift-fit-universal-thread-1-1-4-l>: HTTP status code is not handled or not allowed
2026-01-10 19:05:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-oem-replacement-motor-1-10-hp-1100-rpm-208-230v-teao>: HTTP status code is not handled or not allowed
2026-01-10 19:05:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-straight-male-internal-hex-8mm-tube-x-1-8-swift-fit-universal-thread-5-9-l>: HTTP status code is not handled or not allowed
2026-01-10 19:05:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-l1321t-1-5-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:05:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-boltless-shelving-48-inch-w-x-30-inch-d-x-84-inch-h-3-levels-add-on-w-wire-decking-black>: HTTP status code is not handled or not allowed
2026-01-10 19:05:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-idvsnm2333t-15-hp-5400-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:05:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v-grip-wire-shelving-spill-containment-system-4-shelves-trays-36-w-x-18-d-x-84-h-add-on-black>: HTTP status code is not handled or not allowed
2026-01-10 19:05:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-with-keyless-entry-lock-60-w-x-24-d-x-75-h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:05:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v-grip-pre-configured-wire-shelving-spill-containment-system-48-w-x-18-d-x-84-h-starter-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:05:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-canvas-functional-cargo-pant-black-wp80-32x30-wp80bk3230>: HTTP status code is not handled or not allowed
2026-01-10 19:05:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-brute-plastic-round-bucket-14-quart-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:05:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filter-multi-pleat-xl10-14-w-x-25-h-x-1-d-12-ctn>: HTTP status code is not handled or not allowed
2026-01-10 19:05:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filter-multi-pleat-xl10-hc-16-w-x-20-h-x-1-d-12-ctn>: HTTP status code is not handled or not allowed
2026-01-10 19:05:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-boltless-shelving-96-inch-w-x-48-inch-d-1-level-w-wood-decking-black>: HTTP status code is not handled or not allowed
2026-01-10 19:05:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-union-14mm-tube-2-l>: HTTP status code is not handled or not allowed
2026-01-10 19:05:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bowl-brush-polypro-12-case-96311>: HTTP status code is not handled or not allowed
2026-01-10 19:05:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-stainless-steel-cable-assembly-for-davit-cranes>: HTTP status code is not handled or not allowed
2026-01-10 19:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/appliances/cooking_equipment/ovens already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:05:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rivetwell-ez-deck-decking-48-inch-w-x-24-inch-d-x-3-4-inch-h-for-use-w-double-rivets>: HTTP status code is not handled or not allowed
2026-01-10 19:05:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slab-super-crib-6-12-24-15231>: HTTP status code is not handled or not allowed
2026-01-10 19:05:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jack-plate-with-non-skid-surface-18-18-2-14469>: HTTP status code is not handled or not allowed
2026-01-10 19:05:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rivetwell-particle-board-decking-36-inch-w-x-15-inch-d-x-5-8-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:06:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/warming-cabinet-30-w-x-74-1-2-h-x-26-5-8-d-freestanding-1-glass-door-3-adj-shelves>: HTTP status code is not handled or not allowed
2026-01-10 19:06:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-run-tee-3-8-tube-x-1-8-swift-fit-universal-thread-1-l>: HTTP status code is not handled or not allowed
2026-01-10 19:06:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-l3504m-1-2-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:06:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-x-8-butyl-pads-for-adhesion-to-road-surface>: HTTP status code is not handled or not allowed
2026-01-10 19:06:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neon-shop-ticket-holder-pink-stitched-both-sides-clear-9-x-12-15ea-bx>: HTTP status code is not handled or not allowed
2026-01-10 19:06:05 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/foodservice/appliances/cooking_equipment/ovens> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/foodservice/appliances/cooking_equipment/ovens landed on page that is not a product page.
2026-01-10 19:06:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-tab-poly-binder-index-dividers-with-slant-pockets-assorted-5-st>: HTTP status code is not handled or not allowed
2026-01-10 19:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:06:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plush-entrance-mat-3x10-charcoal-black>: HTTP status code is not handled or not allowed
2026-01-10 19:06:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-needle-valve-screw-adjustment-1-8-fm-nptf-x-1-8-swift-fit-universal-thread-0-l>: HTTP status code is not handled or not allowed
2026-01-10 19:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:06:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11856 pages (at 93 pages/min), scraped 4992 items (at 41 items/min)
2026-01-10 19:06:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-l3608t-5-hp-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:06:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-reinforced-external-push-on-ring-015-thick-stamped-carbon-spring-steel-phosphate>: HTTP status code is not handled or not allowed
2026-01-10 19:06:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/radial-steel-wool-floor-pads-grade-0-20>: HTTP status code is not handled or not allowed
2026-01-10 19:06:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xtra-st1600h-ultrasonic-cleaner-208v-3-ph-dual-freq-25-45-khz-high-power-35-gallons>: HTTP status code is not handled or not allowed
2026-01-10 19:06:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/decontamination-station-116-w-x-30-d-base-cabinets-3-sink-bowls-deck-mounted-faucets>: HTTP status code is not handled or not allowed
2026-01-10 19:06:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m1509t-7-5-3-8-hp-1740-860-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:06:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits>: HTTP status code is not handled or not allowed
2026-01-10 19:06:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dupont-tyvek-security-wristbands-blue-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:06:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/pallet_racks/pallet_rack_kits>: HTTP status code is not handled or not allowed
2026-01-10 19:06:20 [py.warnings] (PID: 62) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2026-01-10 19:06:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-l3513-50-1-5-hp-2850-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:06:21 [scrapy.extensions.feedexport] (PID: 62) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:5
2026-01-10 19:06:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-3-black-front-t-shirt-pullover-lime-polyester-3xl>: HTTP status code is not handled or not allowed
2026-01-10 19:06:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jacket-size-tall-men-s-lt-type-r-class-3-fluorescent-yellow-green-black>: HTTP status code is not handled or not allowed
2026-01-10 19:06:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teak-outdoor-table-36-l-36-w-30-h>: HTTP status code is not handled or not allowed
2026-01-10 19:06:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-drawer-cabinet-with-90-drawers-34-w-x-11-3-4-d-x-69-1-8-h>: HTTP status code is not handled or not allowed
2026-01-10 19:06:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-security-shelving-unit-chrome-24-w-x-60-l-x-66-h>: HTTP status code is not handled or not allowed
2026-01-10 19:06:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patio-heater-with-steel-table-gold>: HTTP status code is not handled or not allowed
2026-01-10 19:06:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b30-indoor-outdoor-industrial-vinyl-labels-2-1-4-w-orange-b30c-2250-595-or>: HTTP status code is not handled or not allowed
2026-01-10 19:06:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-smock-loose-fit-short-sleeve-red-xl-tp23>: HTTP status code is not handled or not allowed
2026-01-10 19:06:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-em3587t-2-hp-1750-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:06:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-encp3581t-4-1-hp-1765-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:06:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlake-mecalux-pallet-rack-tear-drop-starter-108-w-x-42-d-x-144-h>: HTTP status code is not handled or not allowed
2026-01-10 19:06:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-em3314t-15-hp-3525-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:06:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knee-boot-size-9-15-h-composite-toe-chevron-plus-outsole-black>: HTTP status code is not handled or not allowed
2026-01-10 19:06:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-family-first-aid-kit-plastic>: HTTP status code is not handled or not allowed
2026-01-10 19:06:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-diamond-series-laboratory-medical-glass-door-refrigerator-72-cu-ft-nswdr723wwg-0>: HTTP status code is not handled or not allowed
2026-01-10 19:06:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kraft-paper-roll-50lb-36-x-1000-feet-red>: HTTP status code is not handled or not allowed
2026-01-10 19:06:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ehfm3211t-3-hp-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:06:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/propane-heater-infrared-vacuum-straight-tube-100000-30l>: HTTP status code is not handled or not allowed
2026-01-10 19:06:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-breathable-jacket-size-men-s-large-attached-hood-black>: HTTP status code is not handled or not allowed
2026-01-10 19:06:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-11in-clear-combination-spot-flood-light-bar-with-12-led-1492160>: HTTP status code is not handled or not allowed
2026-01-10 19:06:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/propane-heater-infrared-vacuum-straight-tube-150000-40l>: HTTP status code is not handled or not allowed
2026-01-10 19:06:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coverallzipper-fronthoodelastic-wrist-and-anklestormflapbound-seamyellowxl>: HTTP status code is not handled or not allowed
2026-01-10 19:06:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-33in-red-rectangular-stop-turn-tail-light-kit-with-15-led-5625115>: HTTP status code is not handled or not allowed
2026-01-10 19:06:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-jl3501a-33-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/scales/portion_price_computing_scales already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:06:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100-pure-coffee-decaffeinated-1-5-oz-pack-42-packs-carton>: HTTP status code is not handled or not allowed
2026-01-10 19:06:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-x-1-5in-rectangular-clear-flood-light-with-3-led-1492139>: HTTP status code is not handled or not allowed
2026-01-10 19:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/plumbing/plumbing_parts_accessories/pipe_hose_tubing_accessories/pipe_markers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:06:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s19-2350-navigator-efx120>: HTTP status code is not handled or not allowed
2026-01-10 19:06:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reversible-insulated-zipper-vest-black-fl-lime-polyurethane-polyester-4xl>: HTTP status code is not handled or not allowed
2026-01-10 19:06:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-powered-orbit-cart-with-40ah-battery-black>: HTTP status code is not handled or not allowed
2026-01-10 19:06:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-tire-bead-breaker-esc70160>: HTTP status code is not handled or not allowed
2026-01-10 19:06:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-metric-master-cylinder-bleeder-kit-thx804>: HTTP status code is not handled or not allowed
2026-01-10 19:06:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pads-pressure-replacement-non-asbestos-2pk-amm9183>: HTTP status code is not handled or not allowed
2026-01-10 19:07:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/scales/portion_price_computing_scales>: HTTP status code is not handled or not allowed
2026-01-10 19:07:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp44352t-4-350-hp-3565-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:07:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/plumbing/plumbing_parts_accessories/pipe_hose_tubing_accessories/pipe_markers>: HTTP status code is not handled or not allowed
2026-01-10 19:07:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1in-clear-round-surface-recess-mount-strobe-lights-with-3-led-8892401>: HTTP status code is not handled or not allowed
2026-01-10 19:07:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/overall-green-40mm-pvc-on-polyester-lg>: HTTP status code is not handled or not allowed
2026-01-10 19:07:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-breathable-jacket-size-men-s-2xl-attached-hood-black>: HTTP status code is not handled or not allowed
2026-01-10 19:07:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2600rc-skirtslack-hanger-heavy-weight-14l-x-12w-plastic-bk-pkg-qty-100>: HTTP status code is not handled or not allowed
2026-01-10 19:07:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-2-polo-pullover-hi-visibilty-shirt-lime-polyester-2xl>: HTTP status code is not handled or not allowed
2026-01-10 19:07:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-15-degree-cap-nailer>: HTTP status code is not handled or not allowed
2026-01-10 19:07:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 11953 pages (at 97 pages/min), scraped 5037 items (at 45 items/min)
2026-01-10 19:07:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fellowes-18-in-electron-rotary-trimmer>: HTTP status code is not handled or not allowed
2026-01-10 19:07:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-gauge-7-32-crown-1-1-4-sx-staple-5000-qty>: HTTP status code is not handled or not allowed
2026-01-10 19:07:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexible-gas-connector-ceramic-heaters>: HTTP status code is not handled or not allowed
2026-01-10 19:07:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3201l-grain-goatskin-driver-gloves-white-large-12-pairs>: HTTP status code is not handled or not allowed
2026-01-10 19:07:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v201-safety-vest-polyester-mesh-hook-closure-orange-one-size>: HTTP status code is not handled or not allowed
2026-01-10 19:07:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrosive-environment-voltage-thermostat-infrared-tube-heaters>: HTTP status code is not handled or not allowed
2026-01-10 19:07:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roll-set-leveling-caster-1100-lb-capacity-swivel-plate-mount-120f>: HTTP status code is not handled or not allowed
2026-01-10 19:07:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/19pc-driver-bit-set-gunmetal-bronze-s2-modified-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:07:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tray-fast-food-14x18-desert-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:07:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/applaud-antibacterial-hand-soap-floral-fragrance-gallon-bottle-338524>: HTTP status code is not handled or not allowed
2026-01-10 19:07:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-weather-faux-rattan-sofa-light-gray-with-light-gray-cushions>: HTTP status code is not handled or not allowed
2026-01-10 19:07:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tray-camtread-13x21-rectangular-taver-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:07:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/btkct011-bleeding-trauma-kit-molle-bag-1-cat-tourniquet-chest-seal>: HTTP status code is not handled or not allowed
2026-01-10 19:07:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lab-design-sink-bench-3-3-4-h-x-30-d-x-107-w-stone-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:07:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orbis-folding-bulk-shipping-container-32x30x34-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:07:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torx-174-25-power-bit-x-3-1-2-s2-modified-steel-gunmetal-grey>: HTTP status code is not handled or not allowed
2026-01-10 19:07:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electrical-rated-gloves-11-l-unlined-smooth-finish-beaded-orange-class-00-size-9>: HTTP status code is not handled or not allowed
2026-01-10 19:07:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-plastic-sign-caution-chock-wheels-before-loading-or-unloading>: HTTP status code is not handled or not allowed
2026-01-10 19:07:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-x-4-seamless-pipe-nipple-schedule-80-304-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:07:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vl3506-75-hp-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:07:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ambidex-disposable-nitrile-industrial-grade-4-mil-textured-l>: HTTP status code is not handled or not allowed
2026-01-10 19:07:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electrical-rated-gloves-black-14-unlined-smooth-finish-beaded-class-0-8>: HTTP status code is not handled or not allowed
2026-01-10 19:07:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-partition-power-pass-through-cable-35-l>: HTTP status code is not handled or not allowed
2026-01-10 19:07:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-partition-base-panel-36-w-x-38-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:07:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-plastic-sign-danger-this-machine-starts-automatically-2>: HTTP status code is not handled or not allowed
2026-01-10 19:07:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-partition-stacking-panel-with-glass-36-w-x-16-h>: HTTP status code is not handled or not allowed
2026-01-10 19:07:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torx-174-tamper-27-insert-bit-x-1-s2-modified-steel-gunmetal-grey>: HTTP status code is not handled or not allowed
2026-01-10 19:07:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transit-bike-shelter-7-30-43-6-l-x-7-5-w-30-bike-capacity-barrel-roof>: HTTP status code is not handled or not allowed
2026-01-10 19:07:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-partition-base-panel-with-baseline-raceway-power-24-w-x-38-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:07:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m3455-25-hp-1140-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/partitions_dividers/cubicle_partition_panels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:07:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esp-kit-1-pair-black-esp-glove-1-pair-cow-class-2-size-9>: HTTP status code is not handled or not allowed
2026-01-10 19:07:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lcm0150-02-manual-lifting-lift-magnet-w-telescoping-pole-150-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:07:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4100-w-36-dg-vertical-panel-channelizer-barricade-w-oversized-handle-white-diamond-grade-sheets>: HTTP status code is not handled or not allowed
2026-01-10 19:07:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4100-o-vertical-panel-channelizer-w-oversized-handle-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:07:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torxt20h-security-insert-bits-1l-14shank>: HTTP status code is not handled or not allowed
2026-01-10 19:07:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-8-precision-flat-washer-1-3-8-o-d-1-8-thick-steel-black-oxide-pkg-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:07:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-2-power-bit-x-2-gunmetal-bronze-s2-modified-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:07:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-zdpm18025c-bv-25-hp-1800-1980-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:07:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gtek-maxifoam-premium-gray-foam-nitrile-coated-palm-finger-tips-xl>: HTTP status code is not handled or not allowed
2026-01-10 19:07:57 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/partitions_dividers/cubicle_partition_panels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/partitions_dividers/cubicle_partition_panels landed on page that is not a product page.
2026-01-10 19:07:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-2-tier-wire-shelving-starter-unit-48w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:07:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/value-priced-inch-cube-inch-sized-compact-refrigerator-freezer-front-mounted-lock>: HTTP status code is not handled or not allowed
2026-01-10 19:08:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torx-174-25-insert-bit-x-1-gunmetal-bronze-s2-modified-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:08:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-2-tier-wire-shelving-add-on-unit-24w-x-14d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:08:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-zdm4117t-30te-hp-3900-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:08:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-2-tier-wire-shelving-add-on-unit-54w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:08:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-5-tier-wire-shelving-starter-unit-36w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:08:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ww3072-heavy-duty-workbench-30-x-72-10000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:08:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-vinyl-sign-danger-unauthorized-persons-keep-out>: HTTP status code is not handled or not allowed
2026-01-10 19:08:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-battery-cable-with-5-16-ring-terminals-4-awg-2-ft-black>: HTTP status code is not handled or not allowed
2026-01-10 19:08:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/watts-wound-filter-cartridges-20lx2-12od-5-micron>: HTTP status code is not handled or not allowed
2026-01-10 19:08:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12050 pages (at 97 pages/min), scraped 5083 items (at 46 items/min)
2026-01-10 19:08:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/watts-wound-filter-cartridges-9-78lx2-12od-5-micron>: HTTP status code is not handled or not allowed
2026-01-10 19:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/plumbing/water_filtration/inline_beverage_ice_machine_filters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:08:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/battery-cable-set-with-5-16-ring-terminals-4-awg-10-ft-black-red>: HTTP status code is not handled or not allowed
2026-01-10 19:08:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cam-follower-sealed-hex-head-2-1-2-l-stud-175-w-roller-3-roller-dia>: HTTP status code is not handled or not allowed
2026-01-10 19:08:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cam-follower-heavy-sealed-hex-head-2-3-4-l-stud-2-w-roller-35-roller-dia>: HTTP status code is not handled or not allowed
2026-01-10 19:08:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lister-bandage-scissors-7-1-2-l-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:08:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/taylor-neurological-hammer-7-1-2-royal-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:08:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-30-production-workbench-birch-butcher-block-square-edge-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:08:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kelly-hemostatic-forceps-curved-5-1-2-l-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:08:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-3-tier-esd-14w-x-24l-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:08:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/plumbing/water_filtration/inline_beverage_ice_machine_filters>: HTTP status code is not handled or not allowed
2026-01-10 19:08:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/illinois-engineered-products-xleco165-eco-gate-8482-add-on-up-to-12-w-6-h>: HTTP status code is not handled or not allowed
2026-01-10 19:08:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sk2000-boltless-pallet-rack-48-inch-pallet-support-roll-in>: HTTP status code is not handled or not allowed
2026-01-10 19:08:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v5770170-2xl-heelstop-anti-slip-heel-traction-aid-intrinsic>: HTTP status code is not handled or not allowed
2026-01-10 19:08:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-step-heavy-duty-mobile-work-platform-36-x-36-platform>: HTTP status code is not handled or not allowed
2026-01-10 19:08:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-hepa-filter-for-portable-air-conditioner-293149>: HTTP status code is not handled or not allowed
2026-01-10 19:08:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-ceramic-round-chuck-12-dia-3-h>: HTTP status code is not handled or not allowed
2026-01-10 19:08:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/band-saw-blade-compact-48-39-0519>: HTTP status code is not handled or not allowed
2026-01-10 19:08:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexbollard-52h-x-7-14w-w105h-signpost-concrete-blackwhite-xl-b529-c-blackwhite>: HTTP status code is not handled or not allowed
2026-01-10 19:08:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-aluminum-dock-board-with-welded-aluminum-curb-72x36-10-000-lb-capacity-987002>: HTTP status code is not handled or not allowed
2026-01-10 19:08:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-hose-wagon>: HTTP status code is not handled or not allowed
2026-01-10 19:08:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hot-water-rubber-jose-50-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:08:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nature-6-x-6-greenhouse-silver-frame-twin-wall>: HTTP status code is not handled or not allowed
2026-01-10 19:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:08:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/battery-cable-with-reel-1-0-awg-50-ft-black>: HTTP status code is not handled or not allowed
2026-01-10 19:08:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ch-275088-8-12-test-ball-plug-11-psi-25-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:08:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergency-sign-14x10-vinyl-spill-response-equipment>: HTTP status code is not handled or not allowed
2026-01-10 19:08:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergency-sign-10x7-vinyl-first-aid-station>: HTTP status code is not handled or not allowed
2026-01-10 19:08:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honeywell-dual-intermittent-pilot-gas-valve-12x34-standard-35-wc>: HTTP status code is not handled or not allowed
2026-01-10 19:08:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oty-30372-no-95-tinning-flux-lead-free-8-oz>: HTTP status code is not handled or not allowed
2026-01-10 19:08:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vital-cluster-box-unit-w-vogue-classic-accessories-13-unit-1-parcel-locker-sandstone>: HTTP status code is not handled or not allowed
2026-01-10 19:08:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs landed on page that is not a product page.
2026-01-10 19:08:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-four-square-game-stencil-1-8-thick-polytough-plastic-white>: HTTP status code is not handled or not allowed
2026-01-10 19:08:44 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs landed on page that is not a product page.
2026-01-10 19:08:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triple-glove-box-dispenser-22-1-4-w-x-5-d-x-14-3-4-h-maple>: HTTP status code is not handled or not allowed
2026-01-10 19:08:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honeywell-commercialpro>: HTTP status code is not handled or not allowed
2026-01-10 19:08:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honeywell-tradeline-power-pro-model-3-pole-40a-120v>: HTTP status code is not handled or not allowed
2026-01-10 19:08:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-shelf-truck-esd-3-shelf-21w-x-24l-x-40h-polyurethane-4-swivel-2-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:08:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-federal-pedestrian-symbol-1-8-thick-polytough-plastic-white>: HTTP status code is not handled or not allowed
2026-01-10 19:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=two-stage-air-compressor-w-silencer-dryer-5-hp-80-gal-1-phase-230v already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:08:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x18x4-1-2-kraft-open-top-bin-boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:08:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11215-qc-disc-type-r-2-aluminum-oxide-coarse>: HTTP status code is not handled or not allowed
2026-01-10 19:08:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24791-flap-wheel-mandrel-3-8-x-3-8-x-1-8-aluminum-oxide-medium>: HTTP status code is not handled or not allowed
2026-01-10 19:08:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-quart-sharp-container-w-slide-lid-color-red>: HTTP status code is not handled or not allowed
2026-01-10 19:08:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-1-2-inch-x-12-1-2-inch-x-15-inch-doublewall-boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/outdoor_tools_power_equipment/chain_pole_saws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:08:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cloth-belt-82529-1-2-12-120-grit-ceramic>: HTTP status code is not handled or not allowed
2026-01-10 19:08:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-cart-esd-2-shelf-24w-x-30l-polyurethane-4-swivel-2-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:08:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-3-tier-esd-24w-x-60l-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:08:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/searchResult?q=two-stage-air-compressor-w-silencer-dryer-5-hp-80-gal-1-phase-230v>: HTTP status code is not handled or not allowed
2026-01-10 19:09:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parking-lot-stencil-22x4-fire-lane>: HTTP status code is not handled or not allowed
2026-01-10 19:09:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-electric-office-partition-panel-60-14-w-x-65-12-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:09:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-non-electric-office-partition-panel-with-raceway-48-14-w-x-65-12-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:09:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-office-partition-panel-with-partial-window-48-14-w-x-64-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:09:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/outdoor_tools_power_equipment/chain_pole_saws>: HTTP status code is not handled or not allowed
2026-01-10 19:09:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/training-panel-leg-folding-table-18in-x-72in-walnut-top>: HTTP status code is not handled or not allowed
2026-01-10 19:09:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/individual-character-stencil-12-letter-u>: HTTP status code is not handled or not allowed
2026-01-10 19:09:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-high-performance-v2100-rust-preventive-enam-aerosol-lt-bl>: HTTP status code is not handled or not allowed
2026-01-10 19:09:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elite-plus-caribbean-sun-shade-wvalance-remote-pvc-silver-96-x-1205-x-6>: HTTP status code is not handled or not allowed
2026-01-10 19:09:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12144 pages (at 94 pages/min), scraped 5123 items (at 40 items/min)
2026-01-10 19:09:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-3-tier-esd-18w-x-30l-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:09:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-plastic-park-bench-with-backrests-black>: HTTP status code is not handled or not allowed
2026-01-10 19:09:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-18w-x-48l-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:09:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-high-performance-v2100-rust-prevent-enamel-aero-hunter-grn>: HTTP status code is not handled or not allowed
2026-01-10 19:09:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-12w-x-48l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 19:09:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-14w-x-54l-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:09:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/individual-character-stencil-36-letter-p>: HTTP status code is not handled or not allowed
2026-01-10 19:09:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neoprene-foam-with-acrylic-adhesive-14-thick-x-1-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 19:09:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-14w-x-36l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/painting_supplies/specialty_coatings_paint already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:09:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-detectable-silicone-o-ring-dash-223-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 19:09:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neenah-paper-exact-index-card-stock-49561-110-lbs-8-12-x-11-green-250pack>: HTTP status code is not handled or not allowed
2026-01-10 19:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/overhead_clearance_bars_door_guards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:09:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conductive-silicone-o-ring-dash-232-pack-of-5>: HTTP status code is not handled or not allowed
2026-01-10 19:09:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clearance-bar-kit-7-d-x-96-l-white-bar-red-tapes>: HTTP status code is not handled or not allowed
2026-01-10 19:09:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-office-partition-panel-60-14-w-x-43-12-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/painting_supplies/specialty_coatings_paint already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:09:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10x3-1-2-phillips-bugle-head-course-thread-sharp-point-deck-screws-dacrotized-1056DPG>: HTTP status code is not handled or not allowed
2026-01-10 19:09:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-deluxe-office-partition-panel-60-14-w-x-76-12-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:09:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-strength-neoprene-rubber-strip-with-acrylic-adhesive-60a-116-thick-x-12-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 19:09:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/highlandself-stick-pads-6559yw-4-x-6-yellow-100-sheets-12pack>: HTTP status code is not handled or not allowed
2026-01-10 19:09:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-supplies/painting_supplies/specialty_coatings_paint> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-supplies/painting_supplies/specialty_coatings_paint landed on page that is not a product page.
2026-01-10 19:09:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/note-pads-6605pk-4-x-6-canary-yellow-30-sheets-5pack>: HTTP status code is not handled or not allowed
2026-01-10 19:09:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/overhead_clearance_bars_door_guards>: HTTP status code is not handled or not allowed
2026-01-10 19:09:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-18-ga-430-ss-workbench-2-backsplash-galvanized-legs-undershelf-48-x30>: HTTP status code is not handled or not allowed
2026-01-10 19:09:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/asb1180-lawn-and-garden-tire-assembly-size-15-x-600-6>: HTTP status code is not handled or not allowed
2026-01-10 19:09:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/painting_supplies/specialty_coatings_paint>: HTTP status code is not handled or not allowed
2026-01-10 19:09:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/asb1029-golf-tire-assembly-size-18-x-85-8>: HTTP status code is not handled or not allowed
2026-01-10 19:09:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-o-ring-dash-911-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 19:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/paper_stationery/photo_presentation_paper already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:09:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x2-phillips-bugle-head-course-thread-sharp-point-deck-screws-dacrotized-0832DPG>: HTTP status code is not handled or not allowed
2026-01-10 19:09:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x3-4-pan-head-self-tapping-screws-type-a-b-thread-0812ABPPB>: HTTP status code is not handled or not allowed
2026-01-10 19:09:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brown-viton-o-ring-dash-202-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 19:09:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/soft-silicone-o-ring-dash-110-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 19:09:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lockout-tagout-safety-center>: HTTP status code is not handled or not allowed
2026-01-10 19:09:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-high-perform-v2100-rust-prevent-enamel-aero-fluorescent-grn>: HTTP status code is not handled or not allowed
2026-01-10 19:09:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-1600-system-epoxy-rebar>: HTTP status code is not handled or not allowed
2026-01-10 19:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/beds_mattresses/beds_headboards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:09:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c1000-22-commercial-tire-valve-extension>: HTTP status code is not handled or not allowed
2026-01-10 19:09:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/paper_stationery/photo_presentation_paper>: HTTP status code is not handled or not allowed
2026-01-10 19:09:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-531-compact-inflator-gauge-w-digital-gauge-and-straight-head-chuck>: HTTP status code is not handled or not allowed
2026-01-10 19:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/beds_mattresses/beds_headboards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:09:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vanity-wastebasket-2953-6-quart-white-261588wh>: HTTP status code is not handled or not allowed
2026-01-10 19:09:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fda-silicone-tubing-1id-x-1-14od-x-50-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:09:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x2-flat-self-drilling-screws-0832KQF>: HTTP status code is not handled or not allowed
2026-01-10 19:09:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flagging-tape-fluorescent-pink-2>: HTTP status code is not handled or not allowed
2026-01-10 19:09:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flagging-tape-fluorescent-orange-2>: HTTP status code is not handled or not allowed
2026-01-10 19:09:56 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/beds_mattresses/beds_headboards> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/beds_mattresses/beds_headboards landed on page that is not a product page.
2026-01-10 19:09:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m10-1-5x60-din-6921-class-8-point-8-metric-flange-bolt-M1060BF8>: HTTP status code is not handled or not allowed
2026-01-10 19:09:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-tilt-cart-48l-x-32w-150-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:09:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reinforced-high-pressure-fda-silicone-tubing-1id-x-1-38od-x-25-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:09:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/beds_mattresses/beds_headboards>: HTTP status code is not handled or not allowed
2026-01-10 19:09:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/executive-recycled-weekly-monthly-planner-refill-8-x-11-2015-2016-aag7091110>: HTTP status code is not handled or not allowed
2026-01-10 19:10:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-air-compressor-7100e15v-value-plus-460v-3ph-60hz>: HTTP status code is not handled or not allowed
2026-01-10 19:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/beds_mattresses/beds_headboards already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:10:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/300-lb-clutch-jack-7790>: HTTP status code is not handled or not allowed
2026-01-10 19:10:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/resilient-anti-slip-tape-black-6-w-case-of-50-24-l>: HTTP status code is not handled or not allowed
2026-01-10 19:10:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/detectable-underground-warning-tape-caution-buried-potable-line-below-2-w>: HTTP status code is not handled or not allowed
2026-01-10 19:10:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/display-unit-3-tier-chrome-18-w-x-48-l-x-34-h>: HTTP status code is not handled or not allowed
2026-01-10 19:10:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x4-bugle-head-drywall-screws-0864DQG>: HTTP status code is not handled or not allowed
2026-01-10 19:10:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-foam-with-high-temp-adhesive-116-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 19:10:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ventless-dual-fuel-log-set-18-stacked-red-oak-30000-btu-t-stat-control>: HTTP status code is not handled or not allowed
2026-01-10 19:10:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12237 pages (at 93 pages/min), scraped 5161 items (at 38 items/min)
2026-01-10 19:10:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-15-11110-160-psi-18-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 19:10:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/beds_mattresses/beds_headboards>: HTTP status code is not handled or not allowed
2026-01-10 19:10:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-4-11110-30inhg15psi-14-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 19:10:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-fuel-ventless-gas-fireplace-w-mantel-32000-btu-remote-control-walnut>: HTTP status code is not handled or not allowed
2026-01-10 19:10:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/titan-solar-light-bronze-black>: HTTP status code is not handled or not allowed
2026-01-10 19:10:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-retardant-silicone-foam-no-adhesive-132-thick-x-12w-x-10l>: HTTP status code is not handled or not allowed
2026-01-10 19:10:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wow-retractable-gel-pen-medium-0-7mm-black-ink-clear-black-barrel-24-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:10:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-32x1-button-head-socket-cap-screws-1116CSB>: HTTP status code is not handled or not allowed
2026-01-10 19:10:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-drop-in-anchor-284949>: HTTP status code is not handled or not allowed
2026-01-10 19:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:10:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hirsh-industries-10000-series-lateral-file-36in-wide-3-drawer-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 19:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/flashlights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:10:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/recycled-four-person-group-daily-appointment-book-black-8-x-10-7-8-2015-aag7082205>: HTTP status code is not handled or not allowed
2026-01-10 19:10:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-silicone-foam-with-high-temp-adhesive-116-thick-x-34w-x-8l>: HTTP status code is not handled or not allowed
2026-01-10 19:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/address_shipping_labels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:10:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-foam-with-high-temp-adhesive-116-thick-x-18w-x-10l>: HTTP status code is not handled or not allowed
2026-01-10 19:10:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-rubber-strip-with-high-temp-adhesive-40a-116-thick-x-12w-x-10l>: HTTP status code is not handled or not allowed
2026-01-10 19:10:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-13x3-hex-tap-bolts-5048BHT>: HTTP status code is not handled or not allowed
2026-01-10 19:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/pens already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:10:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-lockers-four-tier-12-x-12-x-18-12-door-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:10:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hirsh-industries-10000-series-lateral-file-36in-wide-2-drawer-putty>: HTTP status code is not handled or not allowed
2026-01-10 19:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:10:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs>: HTTP status code is not handled or not allowed
2026-01-10 19:10:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/flashlights>: HTTP status code is not handled or not allowed
2026-01-10 19:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/hand_tools_1/wrenches/combination_wrenches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:10:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pediatric-forearm-crutches-large-knight-blue-pair>: HTTP status code is not handled or not allowed
2026-01-10 19:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/wheelchairs_physical_aids/canes_crutches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:10:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/labels_label_makers/labels/address_shipping_labels>: HTTP status code is not handled or not allowed
2026-01-10 19:10:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gravity-9-long-term-care-pressure-redistribution-mattress-no-cut-out-42w-x-80l>: HTTP status code is not handled or not allowed
2026-01-10 19:10:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-floor-sign-arrow>: HTTP status code is not handled or not allowed
2026-01-10 19:10:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-four-drawer-procedure-cart-with-standard-key-lock-pink>: HTTP status code is not handled or not allowed
2026-01-10 19:10:39 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/pens> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/basic_supplies/pens_pencils_markers/pens landed on page that is not a product page.
2026-01-10 19:10:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-sign-12x9-fire-extinguisher>: HTTP status code is not handled or not allowed
2026-01-10 19:10:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs>: HTTP status code is not handled or not allowed
2026-01-10 19:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:10:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6003zznr-double-shielded-wsnap-ring-17mm-bore-35mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:10:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/hand_tools_1/wrenches/combination_wrenches>: HTTP status code is not handled or not allowed
2026-01-10 19:10:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/medical-lab/wheelchairs_physical_aids/canes_crutches>: HTTP status code is not handled or not allowed
2026-01-10 19:10:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/easy-peel-laser-address-labels-1-x-2-5-8-white-750-pack-5260>: HTTP status code is not handled or not allowed
2026-01-10 19:10:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cable-puller-jcp-series-with-6-lift-4000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:10:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nestable-dunnage-rack-24x18x8>: HTTP status code is not handled or not allowed
2026-01-10 19:10:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-x-9-working-length-j-hook-style-b>: HTTP status code is not handled or not allowed
2026-01-10 19:10:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/automatic-label-applicator-for-square-rectangular-items-up-to-12-w-boxmate-612>: HTTP status code is not handled or not allowed
2026-01-10 19:10:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/automatic-label-applicator-for-dual-or-single-labels-up-to-15-w-bottle-diameter-up-to-6-bottlemate-1510p-2>: HTTP status code is not handled or not allowed
2026-01-10 19:10:52 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/lighted_emergency_exit_signs/self_luminous_emergency_exit_signs landed on page that is not a product page.
2026-01-10 19:10:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23-pocket-verticle-literature-rack-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:10:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-fixed-spreader-beam-yellow-100000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:10:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-shop-desk-open>: HTTP status code is not handled or not allowed
2026-01-10 19:10:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-r6-open-0375-bore-0875-od>: HTTP status code is not handled or not allowed
2026-01-10 19:10:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tall-isolation-cart-3-drawers-standard-key-lock-37-1-2-wx22-lx42-63-100-h-mauve>: HTTP status code is not handled or not allowed
2026-01-10 19:10:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23-w-mobile-bench-cabinet-1-shelf>: HTTP status code is not handled or not allowed
2026-01-10 19:11:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-x-12-working-length-j-hook-style-9>: HTTP status code is not handled or not allowed
2026-01-10 19:11:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-96-economy-h-beam-adjustable-length-yellow-18-l-x-40-w-x-108-h-215lbs-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:11:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-deep-parts-bin-32-openings>: HTTP status code is not handled or not allowed
2026-01-10 19:11:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-hopper-grinder-storage-system-hopper-rack-mhg-4-position>: HTTP status code is not handled or not allowed
2026-01-10 19:11:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6907-open-35mm-bore-55mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:11:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-emergency-crash-cart-6-drawers-36-3-4-w-x-22-l-x-43-h-pink>: HTTP status code is not handled or not allowed
2026-01-10 19:11:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6311-2rs-double-sealed-55mm-bore-120mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:11:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-spread-basket-lifting-beam-yellow-10000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:11:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-29-hydraulic-ergonomic-workbench-steel-top>: HTTP status code is not handled or not allowed
2026-01-10 19:11:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12325 pages (at 88 pages/min), scraped 5197 items (at 36 items/min)
2026-01-10 19:11:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/divider-for-small-drawer-clear-40716>: HTTP status code is not handled or not allowed
2026-01-10 19:11:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-placard-four-digit-1017-1>: HTTP status code is not handled or not allowed
2026-01-10 19:11:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-weight-inspection-gloves-unhemmed-mens-97-540>: HTTP status code is not handled or not allowed
2026-01-10 19:11:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-lycra-glove-nitrile-coated-extra-34-874-xxxl>: HTTP status code is not handled or not allowed
2026-01-10 19:11:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/i-fit-flex-safety-glasses-orange-frame-clear-lens-16267>: HTTP status code is not handled or not allowed
2026-01-10 19:11:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-vis-nylon-lycra-glove-nitrile-coated-34-874fy-xl>: HTTP status code is not handled or not allowed
2026-01-10 19:11:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/19437-americana-full-brim-hard-hat-vent-mega-ratchet-4-pt-nylon-suspension-hi-viz-org>: HTTP status code is not handled or not allowed
2026-01-10 19:11:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cold-protection-insulated-hi-vis-terry-glove-latex-coated-41-1420-s>: HTTP status code is not handled or not allowed
2026-01-10 19:11:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-feet-x-14-feet-sf-9-93-oz-water-resist-canvas-tarp-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:11:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62254-s363pb-class-2-zip-up-mesh-economy-vest-w-pockets-hi-vis-lime-w-black-bottom-3xl>: HTTP status code is not handled or not allowed
2026-01-10 19:11:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/19304-americana-full-brim-hard-hat-w-accessory-slots-standard-4-pt-suspension-red>: HTTP status code is not handled or not allowed
2026-01-10 19:11:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jkl-115-limited-personnel-blow-off-and-drying-system>: HTTP status code is not handled or not allowed
2026-01-10 19:11:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/retractable-belt-stanchion-40-high-14-base-13-belt-6-social-distancing>: HTTP status code is not handled or not allowed
2026-01-10 19:11:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edge-protectors-2-x-2-x-48-225-thick-white-1540-skid>: HTTP status code is not handled or not allowed
2026-01-10 19:11:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6918zz-double-sealed-90mm-bore-125mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:11:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-freestanding-undercounter-freezer-4-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:11:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-headroom-hoist-trolley-combo-manual-6000-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:11:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-hr-time-switched-duty-cycle-dial-plastic-enclosure>: HTTP status code is not handled or not allowed
2026-01-10 19:11:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multivolt-365-day-4-zone-lighting-control-30a-spdt-w-portable-mem-module>: HTTP status code is not handled or not allowed
2026-01-10 19:11:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-frame-72-x-74-yellow-800-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:11:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/markerboard-activity-table-24in-x-60in-rectangle-standard-adjustable-height>: HTTP status code is not handled or not allowed
2026-01-10 19:11:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-z-brite-3-shelf-container-rack-with-2-solid-shelves-bk18486sz-48w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 19:11:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/litestak-led-light-module-120vac-amber-lsld-120a>: HTTP status code is not handled or not allowed
2026-01-10 19:11:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1000-drylin-t-hard-anodized-aluminum-rail-size-15>: HTTP status code is not handled or not allowed
2026-01-10 19:11:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strobe-12-24vdc-pipe-surface-mount-amber-fb2pst-012-024a>: HTTP status code is not handled or not allowed
2026-01-10 19:11:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strobe-pipe-mount-120vac-green-lp3p-120g>: HTTP status code is not handled or not allowed
2026-01-10 19:11:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strobe-120vac-hazardous-location-clear-151xst-120c>: HTTP status code is not handled or not allowed
2026-01-10 19:11:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-x-1-2-iglide-g300-polymer-flange-bearing>: HTTP status code is not handled or not allowed
2026-01-10 19:11:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/250mm-dia-slewing-ring-bearing-17984-lbs-max-axial-static>: HTTP status code is not handled or not allowed
2026-01-10 19:11:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/300mm-dia-slewing-ring-bearing-22480-lbs-max-axial-static>: HTTP status code is not handled or not allowed
2026-01-10 19:11:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/down-flow-unit-heater-summer-fan-switch>: HTTP status code is not handled or not allowed
2026-01-10 19:11:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-trade-show-supertrunk-foam-lined-with-wheels-843-36-fl-ww-38x26x26-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:11:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-0ml-screw-top-micro-tube-cap-self-standing-grip-band-green-grip-cap-sterile-500pk>: HTTP status code is not handled or not allowed
2026-01-10 19:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_bridges_returns already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:11:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-series-aluminium-medical-cart-short-height-36-3-4-w-x-22-l-x-37-1-4-h-hammertone-black>: HTTP status code is not handled or not allowed
2026-01-10 19:11:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-2-drylin-r-twin-bearing-block-with-polymer-liner>: HTTP status code is not handled or not allowed
2026-01-10 19:11:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triple-column-storage-cabinet-electronic-keypad-lock-60-w-x-28-d-x-81-h-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:11:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-narrow-procedure-cart-6-drawers-key-lock-18-w-x-18-l-x-40-3-4-h-brushed-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:11:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-mailing-tubes-5-x-5-x-48-200-ect-32-kraft>: HTTP status code is not handled or not allowed
2026-01-10 19:11:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m20-25-carbon-steel-insert-for-metal-450-20>: HTTP status code is not handled or not allowed
2026-01-10 19:11:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/facility-visi-sign-men-4>: HTTP status code is not handled or not allowed
2026-01-10 19:11:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-28-insert-for-hard-wood-brass-400-428>: HTTP status code is not handled or not allowed
2026-01-10 19:11:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/syringe-filter-ca-0-45-181-m-30mm-sterile-red-polypropylene-30-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:11:58 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_bridges_returns> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_bridges_returns landed on page that is not a product page.
2026-01-10 19:11:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boltless-heavy-duty-die-rack-96-w-x-24-d-x-84-h-5-shelves-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:12:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tall-isolation-cart-3-drawers-standard-key-lock-37-1-2-wx22-lx42-63-100-h-burgundy>: HTTP status code is not handled or not allowed
2026-01-10 19:12:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/250ml-filter-system-pes-filter-material-0-10-181-m-75mm-sterile-polystyrene-12-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:12:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1161226-comfort-construction-style-climbing-harness-pass-through-tongue-buckle-s>: HTTP status code is not handled or not allowed
2026-01-10 19:12:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-anesthesia-cart-6-drawers-e-lock-47-5-8-w-x-22-l-x-66-3-4-h-mauve>: HTTP status code is not handled or not allowed
2026-01-10 19:12:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-height-triple-column-medical-storage-cabinet-60-2-5-wx27-4-5-dx55-3-5-h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:12:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20-insert-for-soft-wood-flanged-901420-20>: HTTP status code is not handled or not allowed
2026-01-10 19:12:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-sign-caution-wet-floor-cuidado-piso-mojado>: HTTP status code is not handled or not allowed
2026-01-10 19:12:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m10-150-carbon-steel-insert-for-metal-330-10>: HTTP status code is not handled or not allowed
2026-01-10 19:12:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12424 pages (at 99 pages/min), scraped 5244 items (at 47 items/min)
2026-01-10 19:12:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-sign-caution-men-working-above-below>: HTTP status code is not handled or not allowed
2026-01-10 19:12:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-cart-standard-width-tall-cabinet-6-drawers-41-2-5-wx22-lx64-1-10-h-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:12:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2000ml-roller-bottle-non-treated-suspension-culture-non-vented-cap-sterile-12pk>: HTTP status code is not handled or not allowed
2026-01-10 19:12:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/515-tank-heavy-duty-shipping-case-tube-with-wheels-14l-x-14w-x-77h-blk>: HTTP status code is not handled or not allowed
2026-01-10 19:12:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/511-rotunda-graphics-case-with-wheels-trade-show-case-14l-x-14w-x-55h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:12:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/light-up-dial-portable-lock-box-set-your-own-combination-5424d>: HTTP status code is not handled or not allowed
2026-01-10 19:12:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/architectural-sign-men-symbol>: HTTP status code is not handled or not allowed
2026-01-10 19:12:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-blower-hadp8-12-hp-3-ph-tefc-cw-top-horizontal>: HTTP status code is not handled or not allowed
2026-01-10 19:12:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rad-2097w-self-test-receptacle-20a-1-47-64-w-x-1-1-32-d-x-4-13-64-h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:12:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-blower-hadp12-3-hp-3-ph-tefc-cw-230460v-top-horizontal-wheel-11-12-x-2-34>: HTTP status code is not handled or not allowed
2026-01-10 19:12:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eco-black-ns-precut-anti-spastic-splint-thumb-piece-1-8-non-perforated-small>: HTTP status code is not handled or not allowed
2026-01-10 19:12:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-soft-splinting-material-24-x-36-x-3-16-non-perforated>: HTTP status code is not handled or not allowed
2026-01-10 19:12:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polly-products-econo-mizer-4-ft-backed-bench-with-arms-cedar-bench-brown-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:12:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k6000-control-key-for-5-pin-cylinder-padlocks>: HTTP status code is not handled or not allowed
2026-01-10 19:12:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tapered-roller-bearing-cup-lm102910>: HTTP status code is not handled or not allowed
2026-01-10 19:12:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tapered-roller-bearing-cup-jlm104910>: HTTP status code is not handled or not allowed
2026-01-10 19:12:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-stainless-steel-double-acting-pneumatic-actuator-740-inch-pounds-torque>: HTTP status code is not handled or not allowed
2026-01-10 19:12:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tapered-roller-bearing-cone-lm300848>: HTTP status code is not handled or not allowed
2026-01-10 19:12:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pgs2k-grounding-bar-system-200mm-copper>: HTTP status code is not handled or not allowed
2026-01-10 19:12:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24vac-nema-4-electric-actuator-200-in-lbs-torque>: HTTP status code is not handled or not allowed
2026-01-10 19:12:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-wafer-style-butterfly-valve-w-viton-seals-and-dbl-acting-pneum-actuator>: HTTP status code is not handled or not allowed
2026-01-10 19:12:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-lad-saf-60-ft-swaged-galvanized-steel-cable-3-8-dia-1-7-strand-6104060>: HTTP status code is not handled or not allowed
2026-01-10 19:12:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-lad-saf-30-ft-vertical-safety-system-stainless-steel-cable-6119030>: HTTP status code is not handled or not allowed
2026-01-10 19:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/outdoor_furniture/grills/grills_smokers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:12:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-lug-style-butterfly-valve-w-buna-seals-and-10-position-handle>: HTTP status code is not handled or not allowed
2026-01-10 19:12:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/siesta-sunshine-resin-dining-arm-chair-green>: HTTP status code is not handled or not allowed
2026-01-10 19:12:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/siesta-sunshine-resin-dining-arm-chair-teak-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:12:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/siesta-miranda-high-back-dining-chair-black>: HTTP status code is not handled or not allowed
2026-01-10 19:12:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-evaporator-fan-motor-for-nexel-models-243007-243008-243009-243010>: HTTP status code is not handled or not allowed
2026-01-10 19:12:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vrtcl-concrete-pressure-tong-w-grip-teeth-550-lbs-cap-1-3-16-6-5-16-grip-range>: HTTP status code is not handled or not allowed
2026-01-10 19:12:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polycarbonate-surface-mounted-90-corner-guard-3-4-inch-wing-4-foot-h-clear-taped>: HTTP status code is not handled or not allowed
2026-01-10 19:12:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fox-earpiece-ep1013xc>: HTTP status code is not handled or not allowed
2026-01-10 19:12:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/outdoor_furniture/grills/grills_smokers>: HTTP status code is not handled or not allowed
2026-01-10 19:12:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-strength-buna-n-rubber-sheet-no-adhesive-60a-332-thick-x-18-wide-x-18-long>: HTTP status code is not handled or not allowed
2026-01-10 19:12:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-lock-solid-aluminum-rectangular-padlock-red-no-a1206red>: HTTP status code is not handled or not allowed
2026-01-10 19:12:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-12-thick-x-34-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 19:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:12:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vertical-lifting-locking-screw-clamp-orange-steel-1000-lbs-capacity-3-4-opening>: HTTP status code is not handled or not allowed
2026-01-10 19:12:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/restricted-area-aluminum-bilingual-unauthorized-persons-keep-out>: HTTP status code is not handled or not allowed
2026-01-10 19:12:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-467-dn6-nipple-w-valve-1-24-25-l>: HTTP status code is not handled or not allowed
2026-01-10 19:12:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-5-16in-one-piece-cast-coupler-0091558>: HTTP status code is not handled or not allowed
2026-01-10 19:12:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dixon-coil-hook-with-pivoting-wedge-1000-lbs-capacity-yellow-12-max-coil-width>: HTTP status code is not handled or not allowed
2026-01-10 19:12:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2in-heavy-duty-ball-mount-w-2in-drop-x-8-1-2in-long-tube-1803075>: HTTP status code is not handled or not allowed
2026-01-10 19:12:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-lab-coat-white-polycombed-cotton-regular-42>: HTTP status code is not handled or not allowed
2026-01-10 19:12:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-button-closure-lab-coat-white-polycotton-2xl>: HTTP status code is not handled or not allowed
2026-01-10 19:12:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vertical-lightweight-pallet-lifter-wheeled-2-ton-capacity-36-fork-length-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:12:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/building_safety_signs landed on page that is not a product page.
2026-01-10 19:12:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-310-compressed-air-hose-kit-314-24-25-l>: HTTP status code is not handled or not allowed
2026-01-10 19:12:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unistrut-1-58-x-3-14-metal-framing-channel-p1001t10pg-12-gage-back-to-back-slotted>: HTTP status code is not handled or not allowed
2026-01-10 19:12:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unistrut-1-58-90-fitting-p1499eg-1-hole-1-slot-electro-galvanized-6-78>: HTTP status code is not handled or not allowed
2026-01-10 19:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-light-15-flush-mount-alabaster-glass-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 19:13:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/td-big-foot-mobile-fall-protection-device>: HTTP status code is not handled or not allowed
2026-01-10 19:13:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xx-garolite-sheet-34-thick-x-6-wide-x-6-long>: HTTP status code is not handled or not allowed
2026-01-10 19:13:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dripless-caulk-guns-ergo-tech-ets-3000-10-oz-caulk-gun>: HTTP status code is not handled or not allowed
2026-01-10 19:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-assembly-for-hx-80-end-rider-pallet-truck-pr-27626-000>: HTTP status code is not handled or not allowed
2026-01-10 19:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/flush_mount_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unistrut-1-58-4-hole-90-fitting-p1325eg-electro-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 19:13:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-lab-coat-navy-polycombed-cotton-regular-54>: HTTP status code is not handled or not allowed
2026-01-10 19:13:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12518 pages (at 94 pages/min), scraped 5282 items (at 38 items/min)
2026-01-10 19:13:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frost-double-sanitary-napkin-tampon-vendor-stainless>: HTTP status code is not handled or not allowed
2026-01-10 19:13:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-plastic-bar-w-lse-acrylic-adhesive-12-thick-x-2-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 19:13:11 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 19:13:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xx-garolite-sheet-58-thick-x-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 19:13:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-way-die-cast-metal-trailer-connector-truck-side-tc1004>: HTTP status code is not handled or not allowed
2026-01-10 19:13:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36x36x86-chrome-wire-shelving-with-8-36-d-hopper-bins-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:13:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits>: HTTP status code is not handled or not allowed
2026-01-10 19:13:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/flush_mount_lights>: HTTP status code is not handled or not allowed
2026-01-10 19:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-built-in-combination-lock-with-long-bolt-green-dial-left-hinged>: HTTP status code is not handled or not allowed
2026-01-10 19:13:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-konnect-stackable-accessory-tray-black-6-case>: HTTP status code is not handled or not allowed
2026-01-10 19:13:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/professional-magnetic-staple-remover-black-144-case>: HTTP status code is not handled or not allowed
2026-01-10 19:13:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/connector-for-m-series-stacker-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 19:13:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bushing-for-gpw-series-pallet-trucks-cr-042053-009>: HTTP status code is not handled or not allowed
2026-01-10 19:13:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glue-krazy-glue-single-use-tubes-w-storage-case-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:13:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bhg05xl-box-handler-gloves-1-pair-black-x-large>: HTTP status code is not handled or not allowed
2026-01-10 19:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/riser-for-mpb-040-e-b827-mpw-045-e-b802-pallet-trucks-yl-524250478>: HTTP status code is not handled or not allowed
2026-01-10 19:13:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24x36x75-steel-shelving-with-10-24-d-hopper-bins-red>: HTTP status code is not handled or not allowed
2026-01-10 19:13:27 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 19:13:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-premium-scissors-gray-36-case>: HTTP status code is not handled or not allowed
2026-01-10 19:13:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-drum-rack-containment-systems-4-drum-system-with-drain>: HTTP status code is not handled or not allowed
2026-01-10 19:13:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magic-greener-tape-3-4-x-900-1-core-12-rolls-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:13:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roller-for-8300-8400-8500-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 19:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjust-a-shelf-school-locker-shelf-black-6-case>: HTTP status code is not handled or not allowed
2026-01-10 19:13:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laminated-slide-effect-174-dock-bumper-w-tilt-bracket-6-1-2-wx13-dx20-h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:13:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers>: HTTP status code is not handled or not allowed
2026-01-10 19:13:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tumbler-nt-12oz-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-lock-set-with-keys-for-cabinet-model-237635-rp9008>: HTTP status code is not handled or not allowed
2026-01-10 19:13:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-stadium-series-trash-container-w-dome-top-55-gallon-black-261596bk>: HTTP status code is not handled or not allowed
2026-01-10 19:13:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-116-thick-x-34-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 19:13:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bowl-nappie-15-3oz-black>: HTTP status code is not handled or not allowed
2026-01-10 19:13:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-electric-chain-hoist-push-trolley-1-12-10-18>: HTTP status code is not handled or not allowed
2026-01-10 19:13:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits landed on page that is not a product page.
2026-01-10 19:13:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-supplied-air-respirator-vortex-cooling-assembly-belt-mounted>: HTTP status code is not handled or not allowed
2026-01-10 19:13:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-tri-flange-earplugs-corded-cloth>: HTTP status code is not handled or not allowed
2026-01-10 19:13:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-tray-supports-for-fellowes-wire-desk-trays-60012-5-1-2-inch-4-set-black>: HTTP status code is not handled or not allowed
2026-01-10 19:13:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits>: HTTP status code is not handled or not allowed
2026-01-10 19:13:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-8482-tear-drop-pallet-rack-starter-48-w-x-24-d-x-96-h>: HTTP status code is not handled or not allowed
2026-01-10 19:13:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-bar-38-thick-x-38-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 19:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/550s-top-chest-w-12-drawers-50-w-x-25-1-4-d-x-27-h-red>: HTTP status code is not handled or not allowed
2026-01-10 19:13:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gt-beam-trolly-4400-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:13:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/control-head-for-mpb-040-e-b827-mpw-045-e-b802-pallet-trucks-yl-524182434>: HTTP status code is not handled or not allowed
2026-01-10 19:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-single-arm-shelf-bracket-green-pair>: HTTP status code is not handled or not allowed
2026-01-10 19:13:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-electric-chain-hoist-motor-trolley-1-12-10-18>: HTTP status code is not handled or not allowed
2026-01-10 19:13:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roller-shaft-for-pe-4000-pallet-trucks-cr-113365>: HTTP status code is not handled or not allowed
2026-01-10 19:13:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-3-thick-x-8-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 19:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:13:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solenoid-switch-for-w-40-xl-w-40-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 19:13:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-merv-8-high-capacity-xl8-pleated-extended-surface-20-inch-w-x-20-inch-h-x-1-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 19:13:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock landed on page that is not a product page.
2026-01-10 19:14:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-flat-polyurethane-coated-gloves-white-black-small-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 19:14:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hygienic-hi-flex-wall-bracket-system-green-polypropylene-tpe-rubber-polyamide>: HTTP status code is not handled or not allowed
2026-01-10 19:14:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_bar_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:14:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x42x74-chrome-shelving-with-13-magnum-giant-hopper-bins-black>: HTTP status code is not handled or not allowed
2026-01-10 19:14:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-for-111-112-113-114-pallet-trucks-ra-632-069-007>: HTTP status code is not handled or not allowed
2026-01-10 19:14:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterproof-stowaway-utility-box-4-15-adj-compartments-14-l-x-8-7-8-w-x-3-h-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:14:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits>: HTTP status code is not handled or not allowed
2026-01-10 19:14:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-1-thick-x-16-wide-x-32-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-electric-chain-hoist-hook-suspension-12-15-15>: HTTP status code is not handled or not allowed
2026-01-10 19:14:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12611 pages (at 93 pages/min), scraped 5319 items (at 37 items/min)
2026-01-10 19:14:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gripper-front-butcher-coat-wknit-cuffs-pocket-less-spun-polyester-white-m>: HTTP status code is not handled or not allowed
2026-01-10 19:14:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edge-bumper-guard-type-b-yellow-black>: HTTP status code is not handled or not allowed
2026-01-10 19:14:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/material-handling-basket-21l-x-13-1-4w-x-5-7-16h-0-5-wire-plain-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:14:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-fan-18-diameter-three-phase-240-460v-with-grill>: HTTP status code is not handled or not allowed
2026-01-10 19:14:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-fan-24-diameter-three-phase-240-460v-with-grill>: HTTP status code is not handled or not allowed
2026-01-10 19:14:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/full-cut-butcher-coat-white-polyestercotton-s>: HTTP status code is not handled or not allowed
2026-01-10 19:14:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-output-panel-fan-24-dia-single-phase-240v-with-grill>: HTTP status code is not handled or not allowed
2026-01-10 19:14:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hog-heaven-iii-mod-tile-comfort-36-side-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:14:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x36x74-chrome-wire-shelving-with-77-4-h-shelf-bins-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:14:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-1-14-thick-x-4-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-assembly-for-pe-3000-pallet-trucks-cr-77086-a>: HTTP status code is not handled or not allowed
2026-01-10 19:14:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neoprene-rubber-sheet-no-adhesive-70a-18-thick-x-18-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-manifest-stand-ms-1302-59-x-24-x-84-1-2>: HTTP status code is not handled or not allowed
2026-01-10 19:14:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cook-pants-black-white-check-polyestercotton-twill-38-x-30>: HTTP status code is not handled or not allowed
2026-01-10 19:14:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-quart-16428012-clear-storage-tote-with-white-lid-13-5-8-x-8-1-4-x-4-7-8>: HTTP status code is not handled or not allowed
2026-01-10 19:14:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-retardant-neoprene-foam-sheet-with-acrylic-adhesive-116-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-116-thick-x-4-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gripper-front-butcher-frock-wtop-2-lower-outside-pockets-white-polycotton-twill-s>: HTTP status code is not handled or not allowed
2026-01-10 19:14:28 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 19:14:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ballymore-12-step-serrated-cantilever-ladder-42-overhang>: HTTP status code is not handled or not allowed
2026-01-10 19:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/retail_fixtures_displays_equipment/garment_supplies/sewing_machines already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:14:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gripper-front-butcher-frock-top-2-lower-outside-pockets-white-polycotton-twill-3xl>: HTTP status code is not handled or not allowed
2026-01-10 19:14:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ballymore-14-step-serrated-cantilever-ladder-28-overhang>: HTTP status code is not handled or not allowed
2026-01-10 19:14:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/collarless-butcher-wrap-wo-pockets-white-polyestercombed-cotton-xl>: HTTP status code is not handled or not allowed
2026-01-10 19:14:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-300-gsm-microfiber-cleaning-cloths-16-x-16-red-12-cloths-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:14:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-square-bar-height-breakroom-table-black>: HTTP status code is not handled or not allowed
2026-01-10 19:14:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheelbarrow-ladder-6-steps-aluminum-350-lb-capacity-14-d-top-step-24-w-step>: HTTP status code is not handled or not allowed
2026-01-10 19:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:14:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-pocket-counter-top-business-card-holder-medium-oak>: HTTP status code is not handled or not allowed
2026-01-10 19:14:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polycarbonate-plastic-sheet-18-thick-x-12-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-plastic-bar-w-lse-acrylic-adhesive-14-thick-x-2-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:39 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/foodservice/retail_fixtures_displays_equipment/garment_supplies/sewing_machines> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/foodservice/retail_fixtures_displays_equipment/garment_supplies/sewing_machines landed on page that is not a product page.
2026-01-10 19:14:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-button-front-chef-coat-pearl-buttons-black-polyestercotton-4xl>: HTTP status code is not handled or not allowed
2026-01-10 19:14:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x39-steel-shelving-with-16-6-h-shelf-bins-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/computers_electronics/computer_tablet_accessories/monitor_risers_stands already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:14:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-tuftex-yellow-bib-overall-plain-front-pvc-size-medium>: HTTP status code is not handled or not allowed
2026-01-10 19:14:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-button-front-chef-coat-pearl-buttons-black-polyestercotton-2xl>: HTTP status code is not handled or not allowed
2026-01-10 19:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:14:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-wax-free-toilet-seal>: HTTP status code is not handled or not allowed
2026-01-10 19:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/rainwear already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:14:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:14:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/soft-epdm-foam-strip-no-adhesive-12-thick-x-34-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-webtex-yellow-jacket-w-attached-hood-pvc-size-3x>: HTTP status code is not handled or not allowed
2026-01-10 19:14:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/male-mannequin-hands-by-side-legs-straight-gloss-finish-white>: HTTP status code is not handled or not allowed
2026-01-10 19:14:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-retardant-neoprene-foam-sheet-no-adhesive-12-thick-x-12-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x60x74-chrome-wire-shelving-with-88-shelf-bins-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:14:52 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/computers_electronics/computer_tablet_accessories/monitor_risers_stands> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/computers_electronics/computer_tablet_accessories/monitor_risers_stands landed on page that is not a product page.
2026-01-10 19:14:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyurethane-dipped-latex-gloves-gl401-series-size-2x-large-pkg-qty-12>: HTTP status code is not handled or not allowed
2026-01-10 19:14:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits>: HTTP status code is not handled or not allowed
2026-01-10 19:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/rainwear already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:14:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/rainwear>: HTTP status code is not handled or not allowed
2026-01-10 19:14:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/pallet_truck_parts_accessories/pallet_truck_wheel_kits>: HTTP status code is not handled or not allowed
2026-01-10 19:14:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-12-thick-x-5-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 19:14:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v-gard-headgear-only-general-purpose-black-10127061>: HTTP status code is not handled or not allowed
2026-01-10 19:14:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-webtex-yellow-bib-overall-plain-front-pvc-size-large>: HTTP status code is not handled or not allowed
2026-01-10 19:15:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extruded-aluminum-hose-cable-bridge-yellow-7178-x-918-x-112>: HTTP status code is not handled or not allowed
2026-01-10 19:15:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-332-thick-x-5-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 19:15:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extruded-aluminum-hose-cable-bridge-silver-60-x-2118-x-3916>: HTTP status code is not handled or not allowed
2026-01-10 19:15:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/rainwear>: HTTP status code is not handled or not allowed
2026-01-10 19:15:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/advantage-respirator-cartridges-ov-ag-gmc-p100-2-pk-815364>: HTTP status code is not handled or not allowed
2026-01-10 19:15:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-12-piece-needle-file-set-length-6-14-cut-2-no-of-pieces-12>: HTTP status code is not handled or not allowed
2026-01-10 19:15:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-56-6-chest-wader-black-steel-toe-w-cleated-outsole-pvc-size-10>: HTTP status code is not handled or not allowed
2026-01-10 19:15:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-office-partition-panel-24-1-4w-x-42h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:15:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5856-w-decorative-corbels-white-polyethylene-11-x-6-x-35-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:15:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12702 pages (at 91 pages/min), scraped 5352 items (at 33 items/min)
2026-01-10 19:15:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ramp-cleat-non-slip-outdoor-rubber-mat-18-thick-3-x-20-black>: HTTP status code is not handled or not allowed
2026-01-10 19:15:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-cap-screw-m12-x-1-25-x-50mm-steel-zinc-clear-class-8-8-din-960-pkg-of-50>: HTTP status code is not handled or not allowed
2026-01-10 19:15:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-platform-to-display-cable-16-4-l>: HTTP status code is not handled or not allowed
2026-01-10 19:15:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-34-thick-x-18-wide-x-18-long>: HTTP status code is not handled or not allowed
2026-01-10 19:15:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/goodyear-coin-pattern-rubber-floor-mat-3-5mm-thick-3-x-10-black>: HTTP status code is not handled or not allowed
2026-01-10 19:15:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slide-box-for-12-slides-cork-lined-white>: HTTP status code is not handled or not allowed
2026-01-10 19:15:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/louvered-panel-portable-bin-cart-black>: HTTP status code is not handled or not allowed
2026-01-10 19:15:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-nut-m16-x-1-5-steel-zinc-clear-class-8-8-din-934-pkg-of-50>: HTTP status code is not handled or not allowed
2026-01-10 19:15:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-3-thick-x-6-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 19:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:15:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-office-partition-panel-with-window-48-1-4w-x-60h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:15:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hitech-ultracompact-stack-chair-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:15:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-12-thick-x-18-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 19:15:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-38-thick-x-36-long-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 19:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:15:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tach-it-micro-s-tagging-guns>: HTTP status code is not handled or not allowed
2026-01-10 19:15:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transfer-pipet-wide-bore-large-bulb-124mm-sterile-polypropylenes-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:15:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/americana-cap-with-accessory-slots-and-4-point-slide-lock-suspension-hi-viz-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/power_tools/plumbing_power_tools/pipe_location_inspection_tools already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:15:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-zenex-padlock-station-20-lock>: HTTP status code is not handled or not allowed
2026-01-10 19:15:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-rubber-strip-no-adhesive-60a-132-thick-x-38-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 19:15:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock landed on page that is not a product page.
2026-01-10 19:15:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-clean-water-plastic-cap-261990-641250-641263-641264-641265-641244-641245>: HTTP status code is not handled or not allowed
2026-01-10 19:15:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tach-it-ex2-2-inch-heavy-duty-carton-sealer>: HTTP status code is not handled or not allowed
2026-01-10 19:15:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tach-it-ex5r-2-inch-spring-mandrel-carton-sealer>: HTTP status code is not handled or not allowed
2026-01-10 19:15:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-materials/plastics/plastic_sheet_stock>: HTTP status code is not handled or not allowed
2026-01-10 19:15:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96in-rectangular-metal-mesh-picnic-table-black>: HTTP status code is not handled or not allowed
2026-01-10 19:15:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-drawer-counter-high-24-w-cabinet-avalanche-blue-2>: HTTP status code is not handled or not allowed
2026-01-10 19:15:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/power_tools/plumbing_power_tools/pipe_location_inspection_tools>: HTTP status code is not handled or not allowed
2026-01-10 19:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/overboots_overshoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:15:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-rod-38-diameter-x-2-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 19:15:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/serological-pipette-10ml-polystyrene-standard-tip-345mm-sterile-orange-band-250-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:15:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-8482-12-down-rod-dc-industrial-ceiling-fan>: HTTP status code is not handled or not allowed
2026-01-10 19:15:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500g-deicing-sprayer-55hp-200p-pump-75-12-hose-manual-reel-7-pro-boom>: HTTP status code is not handled or not allowed
2026-01-10 19:15:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cap-plug-12mm-orange-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:15:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-inch-npt-steel-steam-gauge-syphon>: HTTP status code is not handled or not allowed
2026-01-10 19:15:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-1-2-x12-1-2-white-flat-envelopes>: HTTP status code is not handled or not allowed
2026-01-10 19:15:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x9-kraft-clasp-envelopes>: HTTP status code is not handled or not allowed
2026-01-10 19:15:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lithonia-dga22-drywall-grid-adapter-for-2x2-recessed-fixtures>: HTTP status code is not handled or not allowed
2026-01-10 19:15:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lithonia-rsxf1-led-p4-40k-wfl-mvolt-is-fao-ddbxd-led-floodlight-field-adjustable-wattage-and-lumens-22-133-watts>: HTTP status code is not handled or not allowed
2026-01-10 19:15:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/149630-toughstripe-max-floor-marking-tape-vinyl-2-wide-100-feet-blk-yelow-stripe>: HTTP status code is not handled or not allowed
2026-01-10 19:15:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/overboots_overshoes>: HTTP status code is not handled or not allowed
2026-01-10 19:15:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-drawer-bench-high-36-w-cabinet-light-gray-1>: HTTP status code is not handled or not allowed
2026-01-10 19:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=jtm-1050-mill-with-newall-dp700-dro-x-z-powerfeeds already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:15:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-flat-panel-tilt-mount-black>: HTTP status code is not handled or not allowed
2026-01-10 19:15:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wp3403-iv-keystone-1-gang-3-port-wall-plate-ivory>: HTTP status code is not handled or not allowed
2026-01-10 19:15:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cap-universal-fits-most-12mm-13mm-and-16mm-tubes-blue-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:15:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polly-products-bodega-table-tan-top-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:15:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-compliance-cover-for-hd-single-row-10in-led-light-bar>: HTTP status code is not handled or not allowed
2026-01-10 19:15:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-rated-uninsulated-prime-coat-standard-latch-18x18-fr18x18pc-rtl>: HTTP status code is not handled or not allowed
2026-01-10 19:15:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-rated-uninsulated-prime-coat-standard-latch-14x14-fr14x14pc-rtl>: HTTP status code is not handled or not allowed
2026-01-10 19:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/machining/machinery/lathes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:15:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipette-diamond-pro-fixed-volume-50ul-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:16:00 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=jtm-1050-mill-with-newall-dp700-dro-x-z-powerfeeds> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=jtm-1050-mill-with-newall-dp700-dro-x-z-powerfeeds landed on page that is not a product page.
2026-01-10 19:16:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72in-yellow-plus-ii-quarter-in-hose-with-compact-ball-valve-end-29072>: HTTP status code is not handled or not allowed
2026-01-10 19:16:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jmd-40g-hpf-geared-head-mill-drill-power-downfeed-newall-dp500-dro-x-powerfeed>: HTTP status code is not handled or not allowed
2026-01-10 19:16:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durham-steel-compartment-box-rack-20-x-15-3-4-x-15-with-4-of-32-compartment-boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:16:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wireless-tube-rack-16mm-full-size-72-place-nylon-white>: HTTP status code is not handled or not allowed
2026-01-10 19:16:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-drawer-full-height-48-w-cabinet-light-gray-2>: HTTP status code is not handled or not allowed
2026-01-10 19:16:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-drawer-counter-high-30-w-cabinet-light-gray-4>: HTTP status code is not handled or not allowed
2026-01-10 19:16:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-aquamax-plastic-locker-single-tier-1-wide-12w-x-18d-x-72h-taupe-body-doors>: HTTP status code is not handled or not allowed
2026-01-10 19:16:09 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/machining/machinery/lathes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/machining/machinery/lathes landed on page that is not a product page.
2026-01-10 19:16:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-1254rvs-with-newall-dp700-3x-k-dro-x-y-powerfeeds-air-power-drawbar>: HTTP status code is not handled or not allowed
2026-01-10 19:16:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12795 pages (at 93 pages/min), scraped 5388 items (at 36 items/min)
2026-01-10 19:16:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/culture-tube-12-x-75mm-5ml-polystyrene-with-separate-dual-position-cap-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:16:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-tabs-repositionable-tabs-2-x-1-1-2-neon-green-orange-pink-24-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:16:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/53740-4-centers-deck-faucet-w6-swing-spout-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:16:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/training-table-48-x-24-walnut>: HTTP status code is not handled or not allowed
2026-01-10 19:16:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-milk-cooler-8-crts-dual-sided-34w-33-38d-tmc-34-ds>: HTTP status code is not handled or not allowed
2026-01-10 19:16:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transfer-pipet-70ml-general-purpose-standard-155mm-5000-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:16:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/radius-front-merch-2-section-39-34w-24-14d-gdm-35sl-rf>: HTTP status code is not handled or not allowed
2026-01-10 19:16:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wireless-tube-rack-25mm-half-size-16-place-nylon-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:16:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-x-36-mobile-steel-square-edge-work-bench-adjustable-height-1-1-4-top>: HTTP status code is not handled or not allowed
2026-01-10 19:16:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triton-lbc-4ss-ss-frame-tool-cart-with-tray-and-ss-locboard>: HTTP status code is not handled or not allowed
2026-01-10 19:16:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-inch-to-1-8-inch-barbed-reduction-coupler-non-animal-derived-polypropylene>: HTTP status code is not handled or not allowed
2026-01-10 19:16:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/etm-949-mill-with-x-y-axis-jet-powerfeeds>: HTTP status code is not handled or not allowed
2026-01-10 19:16:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spc-230-handheld-portable-filtration-unit-hepa>: HTTP status code is not handled or not allowed
2026-01-10 19:16:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-foam-latex-coated-gloves-black-navy-x-large-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 19:16:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-nesting-dunnage-rack-60x18x12>: HTTP status code is not handled or not allowed
2026-01-10 19:16:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rv-pette-dispenser-tip-for-repeat-volume-pipettors-certified-sterile-02ml-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:16:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bowl-pebble-camwear-round-18-pebbled>: HTTP status code is not handled or not allowed
2026-01-10 19:16:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/market-tray-10x30-black>: HTTP status code is not handled or not allowed
2026-01-10 19:16:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-glamour-bubble-mailer-7-x-6-3-4>: HTTP status code is not handled or not allowed
2026-01-10 19:16:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/melamine-dry-erase-whiteboard-72-x-48-double-sided-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 19:16:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1852-sl-1-1-4-x-1-4-aluminum-cut-included-angle-bur>: HTTP status code is not handled or not allowed
2026-01-10 19:16:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/etm-949-mill-2-axis-newall-dp700-dro-servo-x-y-z-axis-pwrfds-usa-air-pwrd-draw-bar>: HTTP status code is not handled or not allowed
2026-01-10 19:16:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evs-949-mill-3-axis-acu-rite-303-quill-dro-x-y-z-axis-jet-pwrfds-usa-pwrd-drw-br>: HTTP status code is not handled or not allowed
2026-01-10 19:16:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silver-glamour-bubble-mailer-9-x-11-1-2>: HTTP status code is not handled or not allowed
2026-01-10 19:16:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/110-ton-shop-press-and-portable-power-unit-3-phase-460-volt>: HTTP status code is not handled or not allowed
2026-01-10 19:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=clean-up-sink already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:16:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camrack-base-rack-full-size-4-inch-inside-stack-height-beige-nsf>: HTTP status code is not handled or not allowed
2026-01-10 19:16:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-commercial-duty-exhaust-fan-1-phase-1-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 19:16:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camrack-base-rack-4-1-4-inch-inside-stack-height-navy-blue-nsf>: HTTP status code is not handled or not allowed
2026-01-10 19:16:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rv-pette-dispenser-tip-for-repeat-volume-pipettors-50ml-1-gray-adapter-included-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:16:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-stock-picking-ladder-abrasive-tread-spl-7-14nr>: HTTP status code is not handled or not allowed
2026-01-10 19:16:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-stock-picking-ladder-serrated-tread-spl-6-g>: HTTP status code is not handled or not allowed
2026-01-10 19:16:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-step-stock-picking-ladder-serrated-tread-spl-8-14ng>: HTTP status code is not handled or not allowed
2026-01-10 19:16:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1851-se-51-1-4-x-1-8-standard-cut-egg-shaped-bur>: HTTP status code is not handled or not allowed
2026-01-10 19:16:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-stock-picking-ladder-expanded-tread-spl-6-x>: HTTP status code is not handled or not allowed
2026-01-10 19:16:50 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=clean-up-sink> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=clean-up-sink landed on page that is not a product page.
2026-01-10 19:16:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-dock-board-with-lock-pins-60-w-x-48-l-15-000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:16:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/through-the-wall-air-conditioner-12-000-btu-cool-only-energy-star-115v>: HTTP status code is not handled or not allowed
2026-01-10 19:16:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-corrugated-boxes-15-x-15-x-3>: HTTP status code is not handled or not allowed
2026-01-10 19:16:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bottle-wide-mouth-with-handle-square-polypropylene-4l>: HTTP status code is not handled or not allowed
2026-01-10 19:16:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-corrugated-mailer-7-x-7-x-5->: HTTP status code is not handled or not allowed
2026-01-10 19:16:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ut447ev01-commercial-washout-urinal-wback-spud-cotton>: HTTP status code is not handled or not allowed
2026-01-10 19:16:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/securall-12g-sliding-door-flammable-cabinet-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:16:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-5-step-steel-24w-x-36d-work-platform-ladder-1>: HTTP status code is not handled or not allowed
2026-01-10 19:17:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1848-sf-1-1-4-x-1-4-standard-cut-round-nose-tree-bur>: HTTP status code is not handled or not allowed
2026-01-10 19:17:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-molded-ring-binder-side-open-lilac>: HTTP status code is not handled or not allowed
2026-01-10 19:17:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1846-sb-1-1-4-x-1-4-aluminum-cut-cylindrical-bur-w-end-cut>: HTTP status code is not handled or not allowed
2026-01-10 19:17:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-silver-base-anti-microbial-binder-side-open-mauve>: HTTP status code is not handled or not allowed
2026-01-10 19:17:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/med-book-burgundy>: HTTP status code is not handled or not allowed
2026-01-10 19:17:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/btl-rack-15-double-tier-integral-keyhole-s-s>: HTTP status code is not handled or not allowed
2026-01-10 19:17:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-square-mailing-tubes-4-x-4-x-37->: HTTP status code is not handled or not allowed
2026-01-10 19:17:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipette-tip-1-200ul-certified-universal-natural-54mm-stand-up-resealable-bag-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/abrasives/points_burrs/burrs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:17:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12891 pages (at 96 pages/min), scraped 5432 items (at 44 items/min)
2026-01-10 19:17:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-step-aluminum-rolling-ladder-24w-grip-tread-21d-top-step>: HTTP status code is not handled or not allowed
2026-01-10 19:17:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1848-sf-1l6-1-4-x-1-4-standard-cut-round-nose-tree-bur>: HTTP status code is not handled or not allowed
2026-01-10 19:17:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-x-48-mat-ultimat-gray-um-3648g>: HTTP status code is not handled or not allowed
2026-01-10 19:17:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-molded-ring-binder-side-open-seafoam-green>: HTTP status code is not handled or not allowed
2026-01-10 19:17:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unex-additional-level-for-gravity-flow-roller-rack-with-span-track-96w-x-72d>: HTTP status code is not handled or not allowed
2026-01-10 19:17:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-jacket-protective-gauge-boot-2-12>: HTTP status code is not handled or not allowed
2026-01-10 19:17:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1400xh500-standard-timing-belt-xh-5-x-140-t160-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 19:17:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reversible-microcentrifuge-tube-rack-80-place-60-place-assorted-5-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:17:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-1-4-x-60-1-2-h-deluxe-office-partition-panel-blue-277532bl>: HTTP status code is not handled or not allowed
2026-01-10 19:17:19 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/abrasives/points_burrs/burrs> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/abrasives/points_burrs/burrs landed on page that is not a product page.
2026-01-10 19:17:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snap-n-rack-tube-rack-for-25mm-tubes-40-place-polypropylene-red>: HTTP status code is not handled or not allowed
2026-01-10 19:17:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ice-tray-with-lid-4-liter-red>: HTTP status code is not handled or not allowed
2026-01-10 19:17:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-metal-wristband-medium-4mm>: HTTP status code is not handled or not allowed
2026-01-10 19:17:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/static-shield-metal-in-bag-zip-81705-series-4in-x-6in-100-bagspack>: HTTP status code is not handled or not allowed
2026-01-10 19:17:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/common-point-quad-ground-cord-for-workmat-banana-jacks-10-mm-stud-w-resistor-10ft-cord>: HTTP status code is not handled or not allowed
2026-01-10 19:17:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mini-cooler-20-c-96-place-8x12-for-02ml-pcr-tubes-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:17:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ground-cord-for-floor-mat-10-mm-socket-10ft-cord-no-resistor>: HTTP status code is not handled or not allowed
2026-01-10 19:17:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/penco-vanguard-box-over-locker-18x21x72-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:17:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/412l050-standard-timing-belt-l-1-2-x-41-3-16-t110-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 19:17:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ada-handicap-symbol>: HTTP status code is not handled or not allowed
2026-01-10 19:17:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-174-plastic-jaws-mate-1-x-60-fiberglass-handle>: HTTP status code is not handled or not allowed
2026-01-10 19:17:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/humidity-and-temperature-stability-chamber-single-glass-door-23-cu-ft-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:17:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/centerfeed-hand-towel-dispenser-smoke>: HTTP status code is not handled or not allowed
2026-01-10 19:17:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hospitality-standard-bath-towel-24-x-50-white-60-towels>: HTTP status code is not handled or not allowed
2026-01-10 19:17:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cryoclear-vials-2ml-internal-threads-round-bottom-polypropylene-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:17:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/retractable-weld-screen-5-5-x-20-clear-pvc>: HTTP status code is not handled or not allowed
2026-01-10 19:17:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-angle-beam-48-w-x-48-d-x-84-h-4-level-starter-no-deck-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:17:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graduated-cylinder-polypropylene-molded-graduations-100ml>: HTTP status code is not handled or not allowed
2026-01-10 19:17:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-channel-beam-96-w-x-24-d-x-84-h-4-level-starter-no-deck-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:17:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-drawer-with-label-3-5-8-inch-w-x-15-3-4-inch-d-x-3-1-4-inch-h-price-for-pkg-qty-30>: HTTP status code is not handled or not allowed
2026-01-10 19:17:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snap-n-rack-tube-rack-for-25mm-tubes-40-place-polypropylene-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:17:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50a15hx58-a-plate-58-pitch-58-bore-15-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/boltless_shelving/heavy_duty_boltless_shelves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:17:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ice-caddies-beige-100-lbs-cap-1>: HTTP status code is not handled or not allowed
2026-01-10 19:17:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6005-formaldehyde-organic-vapor-cartridge-2-bag>: HTTP status code is not handled or not allowed
2026-01-10 19:17:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/securall-explosion-proof-light-photocell-exterior-in-addition-to-interior-light>: HTTP status code is not handled or not allowed
2026-01-10 19:17:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cryoclear-vials-5ml-external-threads-self-standing-polypropylene-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/chemical_storage_buildings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:17:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/securall-r-11-insulation-b8000>: HTTP status code is not handled or not allowed
2026-01-10 19:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/workstations/lan_stations already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:17:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-computer-lanstation-workstation-keyboard-tray-34-hx24-wx72-l-black-3-shelf>: HTTP status code is not handled or not allowed
2026-01-10 19:17:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs34hx1316-58-pitch-1-316-finished-bore-34-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:17:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8366-glowear-174-type-r-class-3-lightweight-hi-vis-rain-jacket-lime-m>: HTTP status code is not handled or not allowed
2026-01-10 19:17:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/shelving/boltless_shelving/heavy_duty_boltless_shelves>: HTTP status code is not handled or not allowed
2026-01-10 19:17:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-5-5-8-direct-drive-blower-motor-115-volts-1075-rpm-5>: HTTP status code is not handled or not allowed
2026-01-10 19:17:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-single-phase-jet-pump-motor-115-230-volts-3450-rpm-1-1-2hp-2>: HTTP status code is not handled or not allowed
2026-01-10 19:17:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/test-tube-13-x-75mm-5ml-polystyrene-2000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:17:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/janitorial-facility-maintenance/chemical_storage_buildings> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/janitorial-facility-maintenance/chemical_storage_buildings landed on page that is not a product page.
2026-01-10 19:17:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-pallet-covers-48-x-42-x-48-1-mil-150-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:18:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-5-5-8-permanent-split-capacitor-motor-208-230-volts-1100-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:18:00 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/desks_workstations/workstations/lan_stations> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/desks_workstations/workstations/lan_stations landed on page that is not a product page.
2026-01-10 19:18:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-dunnage-rack-with-solid-top-36-x-36-x-12h>: HTTP status code is not handled or not allowed
2026-01-10 19:18:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/groz-44385-non-sparking-drum-wrench>: HTTP status code is not handled or not allowed
2026-01-10 19:18:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-5-5-8-permanent-split-capacitor-motor-208-230-volts-1075-rpm-2>: HTTP status code is not handled or not allowed
2026-01-10 19:18:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-packing-list-envelopes-7-l-x-5-1-2-w-clear-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:18:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-care-bio-cart-10-hepa-mobile-dust-containment-unit>: HTTP status code is not handled or not allowed
2026-01-10 19:18:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-bank-15a-onboard-battery-charger>: HTTP status code is not handled or not allowed
2026-01-10 19:18:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-folding-compact-crib-with-4-inch-casters-and-foam-mattress>: HTTP status code is not handled or not allowed
2026-01-10 19:18:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 12987 pages (at 96 pages/min), scraped 5473 items (at 41 items/min)
2026-01-10 19:18:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs33hx118-58-pitch-1-18-finished-bore-33-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:18:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foam-mattress-5-inch-thick-full-size-fits-13-series-full-size-cribs>: HTTP status code is not handled or not allowed
2026-01-10 19:18:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/room-temperature-heavy-duty-expandable-foam-bags-22-x-20-96-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:18:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-pallet-covers-58-x-46-x-96-4-mil-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:18:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rechargeable-ni-cd-battery-18-5v>: HTTP status code is not handled or not allowed
2026-01-10 19:18:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-red-4-dia-discs>: HTTP status code is not handled or not allowed
2026-01-10 19:18:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/test-tube-16-x-75mm-8ml-polypropylene-no-rim-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:18:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bright-yellow-2-3>: HTTP status code is not handled or not allowed
2026-01-10 19:18:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transport-tube-5ml-polypropylene-ss-separate-green-screwcap-mg-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:18:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-cart-for-signs-shadow-boards-up-to-72-h-x-36-w-anodized-aluminum-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:18:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-tier-6-door-premium-steel-locker-12-w-x-12-d-x-36-h-black-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:18:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-tier-3-door-premium-steel-locker-12-w-x-12-d-x-72-h-black-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 19:18:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regulated-medical-waste-cart-with-bio-hazard-logo-and-casters-32-gallon-red>: HTTP status code is not handled or not allowed
2026-01-10 19:18:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-5-split-capacitor-fan-coil-motor-208-230-volts-1050-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:18:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/icon-waterproof-breathable-overalls-with-fluorescent-yellow-green-tape-black-5xl>: HTTP status code is not handled or not allowed
2026-01-10 19:18:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/to-go-rack-silver-ep-24w-x-30l-x-63h-4-wire-shelves-dividers-ledges>: HTTP status code is not handled or not allowed
2026-01-10 19:18:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curbside-truck-chrome-18w-x-54l-x-69h-4-wire-shelves-polyurethane-2-rigid-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/outdoor_tools_power_equipment/spreaders_sprayers/seed_spreaders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:18:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/to-go-rack-silver-ep-21w-x-54l-x-63h-4-wire-shelves-dividers-ledges>: HTTP status code is not handled or not allowed
2026-01-10 19:18:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-aluminum-camlock-fitting-dust-plug-thread>: HTTP status code is not handled or not allowed
2026-01-10 19:18:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40bs33hx112-12-pitch-1-12-finished-bore-33-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:18:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-aluminum-camlock-fitting-female-coupler-x-mpt-thread>: HTTP status code is not handled or not allowed
2026-01-10 19:18:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-1-mr-clip-silver-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 19:18:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40bs35hx114-12-pitch-1-14-finished-bore-35-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:18:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/store-in-cool-dry-place-3-5-fluorescent-orange-black>: HTTP status code is not handled or not allowed
2026-01-10 19:18:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-3-5>: HTTP status code is not handled or not allowed
2026-01-10 19:18:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/outdoor_tools_power_equipment/spreaders_sprayers/seed_spreaders>: HTTP status code is not handled or not allowed
2026-01-10 19:18:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-seal-bubble-mailers-000-4-x-8-gold-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/packaging/envelopes_mailers/bubble_mailers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:18:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colorstar-impressions-custom-logo-mat--4--x-6--48-mil-universal-cleated-sbr>: HTTP status code is not handled or not allowed
2026-01-10 19:18:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onyx-surveyors-safety-vest-black-m>: HTTP status code is not handled or not allowed
2026-01-10 19:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/hvac/hvac_controls/thermostats_temperature_controls/thermostats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:18:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs18hx134-1-pitch-1-34-finished-bore-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:18:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-bulk-storage-locker-single-tier-starter-36x36x90>: HTTP status code is not handled or not allowed
2026-01-10 19:18:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-slotted-pallet-rack-starter-no-deck-96-inches-w-x-36-inches-d-x-144-inches-h>: HTTP status code is not handled or not allowed
2026-01-10 19:18:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/non-ansi-teflon-protection-heavy-weight-sweatshirt-w-segment-tape-2xl>: HTTP status code is not handled or not allowed
2026-01-10 19:18:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-slotted-pallet-rack-upright-42-inches-d-x-96-inches-h>: HTTP status code is not handled or not allowed
2026-01-10 19:18:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-slotted-pallet-rack-add-on-no-deck-120-inches-w-x-42-inches-d-x-96-inches-h>: HTTP status code is not handled or not allowed
2026-01-10 19:18:49 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/packaging/envelopes_mailers/bubble_mailers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/packaging/envelopes_mailers/bubble_mailers landed on page that is not a product page.
2026-01-10 19:18:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-e-two-tone-rain-pants-black-4-5xl>: HTTP status code is not handled or not allowed
2026-01-10 19:18:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/touch-free-condiment-dispenser-with-frame-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:18:52 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/hvac/hvac_controls/thermostats_temperature_controls/thermostats> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/hvac/hvac_controls/thermostats_temperature_controls/thermostats landed on page that is not a product page.
2026-01-10 19:18:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mantis-uplight-max-36-wall-sconce-36w-commercial-fly-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:18:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-16bs19hx40-metric-1-pitch-40mm-finished-bore-19-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:18:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/601w-1-4-mnpt-5-16-id-hose-end-fitting>: HTTP status code is not handled or not allowed
2026-01-10 19:18:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/do-not-use-blades-4-6-white-red-black>: HTTP status code is not handled or not allowed
2026-01-10 19:18:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80a45x1-a-plate-1-pitch-1-bore-45-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:18:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/csi-kit-professional-bed-bug-detection>: HTTP status code is not handled or not allowed
2026-01-10 19:19:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transformer-replacemnet-for-nemesis-cm-80>: HTTP status code is not handled or not allowed
2026-01-10 19:19:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-ec2002-2-hp-1-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-eu09-1-1-2-hp-1-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vanilla-cow-tales-box-36-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 19:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-1924-1-2-hp-1-phase-1075-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:19:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honey-maid-honey-graham-crackers-value-pack-4-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 19:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-eu2002b-2-hp-1-phase-3450-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:19:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r134a-recovery-recycling-and-recharge-34788ni>: HTTP status code is not handled or not allowed
2026-01-10 19:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/credenzas already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:19:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/belvita-breakfast-biscuits-blueberry-4-packs-25-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 19:19:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-1374-1-30-hp-1-phase-1100-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13080 pages (at 93 pages/min), scraped 5514 items (at 41 items/min)
2026-01-10 19:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-wd14aa2pz7-1-4-hp-1-phase-1700-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:19:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/candy-jar-assortment-5-lb-gr>: HTTP status code is not handled or not allowed
2026-01-10 19:19:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-reflective-delineator-post-with-square-base-45-height-white>: HTTP status code is not handled or not allowed
2026-01-10 19:19:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frank-s-red-hot-original-hot-sauce-25-oz-2-pack-gr>: HTTP status code is not handled or not allowed
2026-01-10 19:19:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stock-picking-truck-18-48-63-back-to-back-30-cells-13-w>: HTTP status code is not handled or not allowed
2026-01-10 19:19:15 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-1924-1-2-hp-1-phase-1075-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-1924-1-2-hp-1-phase-1075-rpm landed on page that is not a product page.
2026-01-10 19:19:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wide-collapsible-hamper-steel-orange-vinyl-bag>: HTTP status code is not handled or not allowed
2026-01-10 19:19:16 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-eu2002b-2-hp-1-phase-3450-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-eu2002b-2-hp-1-phase-3450-rpm landed on page that is not a product page.
2026-01-10 19:19:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrow-collapsible-hamper-steel-beige-vinyl-bag>: HTTP status code is not handled or not allowed
2026-01-10 19:19:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-110-cfm-energy-star-bath-fan-ae50110dc>: HTTP status code is not handled or not allowed
2026-01-10 19:19:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/credenzas> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/credenzas landed on page that is not a product page.
2026-01-10 19:19:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-panel-mobile-medical-privacy-screen-81-w-x-69-h-beige-vinyl-panels>: HTTP status code is not handled or not allowed
2026-01-10 19:19:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/searchResult?q=us-motor-wd14aa2pz7-1-4-hp-1-phase-1700-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-t12c3jcr-1-2-hp-1-phase-1140-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:19:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrow-collapsible-hamper-steel-gray-vinyl-bag>: HTTP status code is not handled or not allowed
2026-01-10 19:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-t32c2j14-1-1-2-hp-1-phase-1725-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:19:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-6215-1-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-step-extra-rolling-safety-ladder-perforated-tread>: HTTP status code is not handled or not allowed
2026-01-10 19:19:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-1875-1-3-hp-1-phase-825-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heinz-ketchup-mustard-relish-picnic-pack-4-pack-gr>: HTTP status code is not handled or not allowed
2026-01-10 19:19:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lateral-31-3-drawer-fire-and-water-resistant-file-cabinet-light-gray-lat3w31lg>: HTTP status code is not handled or not allowed
2026-01-10 19:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-t3c2p21-3-hp-1-phase-1730-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:19:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-step-24-w-aluminum-tilt-roll-ladder-ribbed-tread>: HTTP status code is not handled or not allowed
2026-01-10 19:19:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-t12c2j4-1-2-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:29 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-t12c3jcr-1-2-hp-1-phase-1140-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-t12c3jcr-1-2-hp-1-phase-1140-rpm landed on page that is not a product page.
2026-01-10 19:19:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexvolt-60v-max-brushless-cordless-reciprocating-saw-bare-tool-only-dcs389b>: HTTP status code is not handled or not allowed
2026-01-10 19:19:30 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-t32c2j14-1-1-2-hp-1-phase-1725-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-t32c2j14-1-1-2-hp-1-phase-1725-rpm landed on page that is not a product page.
2026-01-10 19:19:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pop-rocks-blue-raspberry-24-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 19:19:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keebler-original-club-crackers-snack-stacks-50-oz-gr>: HTTP status code is not handled or not allowed
2026-01-10 19:19:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-step-16-w-stainless-steel-fold-store-ladder-serrated-grating>: HTTP status code is not handled or not allowed
2026-01-10 19:19:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deck-mount-swing-activated-faucet-eyewash-unit-tempered-faucet-right-hand>: HTTP status code is not handled or not allowed
2026-01-10 19:19:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8000-series-direct-feed-jewelry-steam-cleaner>: HTTP status code is not handled or not allowed
2026-01-10 19:19:37 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-t3c2p21-3-hp-1-phase-1730-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-t3c2p21-3-hp-1-phase-1730-rpm landed on page that is not a product page.
2026-01-10 19:19:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-wd12c2jc-1-2-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=us-motor-t1cm2jh-1-hp-1-phase-1725-rpm already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:19:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cart-kit-for-653577-246726-heaters>: HTTP status code is not handled or not allowed
2026-01-10 19:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_rotators_rockers_shakers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:19:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ada-barrier-free-cooler-light-gray-granite-wall-hung-115v-60hz-5-amps>: HTTP status code is not handled or not allowed
2026-01-10 19:19:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washable-replacement-merv8-filter>: HTTP status code is not handled or not allowed
2026-01-10 19:19:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/preventionist-deluxe-six-in-one-infection-control-kiosk-cherry-pv-601-ch>: HTTP status code is not handled or not allowed
2026-01-10 19:19:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-wd12s1ac-1-2-hp-3-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-wd1c2jhc-1-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipeline-36-diameter-gloss-white-round-rack>: HTTP status code is not handled or not allowed
2026-01-10 19:19:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-36-wx24-dx87-h-closed-5-shelf-8-drawer-everest-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:19:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-self-propelled-battery-powered-platform-truck-30x48-1100-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:19:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/juno-6-inch-led-round-baffle-retrofit-downlight-700-lm-2700k-white>: HTTP status code is not handled or not allowed
2026-01-10 19:19:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-galvanized-wall-master-exhaust-belt-drive-1hp-cast-aluminum-blade>: HTTP status code is not handled or not allowed
2026-01-10 19:19:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u3p3d-3-hp-3-phase-1175-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:48 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=us-motor-t1cm2jh-1-hp-1-phase-1725-rpm> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=us-motor-t1cm2jh-1-hp-1-phase-1725-rpm landed on page that is not a product page.
2026-01-10 19:19:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-d32cm2j14-1-1-2-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:49 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_rotators_rockers_shakers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_rotators_rockers_shakers landed on page that is not a product page.
2026-01-10 19:19:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boys-reusable-washable-2-layer-contour-fabric-face-mask-youth-size-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:19:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-shelving-drawer-unit-36x18x39-54-drawers-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:19:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn77-60-1-h-182-4tc-cast-iron-helical-bevel-speed-reducer-182-4tc-input-flange-60-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 19:19:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-shelving-drawer-unit-36x18x75-108-drawers-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:19:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-ee733b-2-hp-3-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-ee734-5-3-hp-3-phase-3525-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-agl10fl1nb-1-hp-1-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn77-7-5-1-h-184tc-cast-iron-helical-bevel-speed-reducer-184tc-input-flange-7-5-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 19:19:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u32p1dc-1-5-hp-3-phase-3505-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u15e2dc-15-hp-3-phase-1775-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:19:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/automatic-liquid-hand-sanitizer-soap-dispenser-800-ml-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:20:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gray-lid-blue-recycling-1-2-cubic-yard-tilt-truck>: HTTP status code is not handled or not allowed
2026-01-10 19:20:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/automatic-foam-hand-sanitizer-soap-dispenser-800-ml-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:20:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-rivet-steel-shelving-with-wood-deck-48-w-x-30-d-x-84-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:20:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steady-burn-light-24vdc-green-lp2-024g>: HTTP status code is not handled or not allowed
2026-01-10 19:20:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-rivet-steel-shelving-with-wood-deck-48-w-x-30-d-x-72-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:20:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-rivet-steel-shelving-with-wood-deck-84-w-x-24-d-x-84-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:20:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lau-4-blade-condenser-propeller-14-diameter-cw-rotation-3>: HTTP status code is not handled or not allowed
2026-01-10 19:20:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-heavy-duty-plastic-chain-25-feet-black>: HTTP status code is not handled or not allowed
2026-01-10 19:20:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-fdu5cm2k18c-5-hp-1-phase-1740-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:20:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-xs1ca2jh-1-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:20:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-yc1p2b-1-hp-3-phase-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:20:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13174 pages (at 94 pages/min), scraped 5540 items (at 26 items/min)
2026-01-10 19:20:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-c200p2c-200-hp-3-phase-1785-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:20:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-stanchion-2-inch-links-c-hooks-2-inch-pole-14-inch-base-41-inch-height-blue->: HTTP status code is not handled or not allowed
2026-01-10 19:20:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-y12s2bcr-0-5-hp-3-phase-1750-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:20:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-stationary-starter-5-vented-shelves-24x60x72>: HTTP status code is not handled or not allowed
2026-01-10 19:20:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-add-on-unit-4-vented-shelves-18x36x64>: HTTP status code is not handled or not allowed
2026-01-10 19:20:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-1699-1-hp-1-phase-1625-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:20:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/255412-countertop-locked-display-case>: HTTP status code is not handled or not allowed
2026-01-10 19:20:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-kan47-10-1-h-182-4tc-cast-iron-helical-bevel-speed-reducer-182-4tc-input-flange-10-1>: HTTP status code is not handled or not allowed
2026-01-10 19:20:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-loop-8>: HTTP status code is not handled or not allowed
2026-01-10 19:20:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-rod-4-30-degree-bend-2>: HTTP status code is not handled or not allowed
2026-01-10 19:20:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-5469-1-3-1-9-hp-1-phase-825-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:20:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-kan47-50-1-h-143tc-cast-iron-helical-bevel-speed-reducer-143tc-input-flange-50-1>: HTTP status code is not handled or not allowed
2026-01-10 19:20:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-ring-stem-so-tread-caster-w-brake-100mm-dia-7-16-x-1-7-16-stem-black>: HTTP status code is not handled or not allowed
2026-01-10 19:20:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/food-storage-container-18x26x3-1-2-5-gallon-capacity-natural-white>: HTTP status code is not handled or not allowed
2026-01-10 19:20:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/threaded-stem-so-tread-caster-with-brake-50mm-dia-3-8-16-x-3-4-stem-black>: HTTP status code is not handled or not allowed
2026-01-10 19:20:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-30-maple-top-with-open-leg>: HTTP status code is not handled or not allowed
2026-01-10 19:20:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-freestanding-office-partition-panel-with-partial-window-24-1-4-w-x-96-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:20:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-drawer-steel-flat-file-30-x-42-documents-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:20:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camwear-food-pan-cover-full-size-with-handle-polycarbonate-clear-nsf>: HTTP status code is not handled or not allowed
2026-01-10 19:20:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deck-mounted-sensor-faucet-chrome>: HTTP status code is not handled or not allowed
2026-01-10 19:20:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-locker-double-tier-1-wide-12-x-15-x-36-beige>: HTTP status code is not handled or not allowed
2026-01-10 19:20:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crock-cover-snap-on-for-cp12-white>: HTTP status code is not handled or not allowed
2026-01-10 19:20:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locker-flat-top-15-x-12-beige>: HTTP status code is not handled or not allowed
2026-01-10 19:20:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-panel-for-slope-top-locker-15-x-72-beige>: HTTP status code is not handled or not allowed
2026-01-10 19:20:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-locker-three-tier-1-wide-12-x-12-x-20-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:20:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-locker-single-tier-1-wide-12-x-18-x-72-deep-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:20:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-elements-mobile-shelf-plate-kit-18-w-x-54-l-solid-brushed-graphite>: HTTP status code is not handled or not allowed
2026-01-10 19:20:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-container-round-6-qt-9-15-16-diameter-x-7-15-16-h-translucent-polypropylene-nsf>: HTTP status code is not handled or not allowed
2026-01-10 19:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:20:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-elements-shelf-plate-kit-18-w-x-72-l-venteded-brushed-graphite>: HTTP status code is not handled or not allowed
2026-01-10 19:20:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-camcart-food-pan-carrier-front-loading-approximately-cap-60-qt-6-casters-navy-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:20:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lavatory-mounted-all-purpose-soap-dispenser-34oz-6-l-spout>: HTTP status code is not handled or not allowed
2026-01-10 19:20:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-tilt-stainless-steel-frame-mirror-18-wx30-h>: HTTP status code is not handled or not allowed
2026-01-10 19:20:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-elements-shelf-plate-kit-24-w-x-48-l-venteded-brushed-graphite>: HTTP status code is not handled or not allowed
2026-01-10 19:20:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cover-for-6-and-8-qt-containers-winter-rose-polyethylene-nsf>: HTTP status code is not handled or not allowed
2026-01-10 19:20:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-female-metal-release-collet-6mm-tube-x-1-8-bspp>: HTTP status code is not handled or not allowed
2026-01-10 19:20:52 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans landed on page that is not a product page.
2026-01-10 19:20:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reducer-3-8-male-stud-x-1-4-tube>: HTTP status code is not handled or not allowed
2026-01-10 19:20:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/janitorial-facility-maintenance/trash_recycling/recycling_bins_receptacles/multi_stream_recycling_cans>: HTTP status code is not handled or not allowed
2026-01-10 19:20:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-elements-post-kit-for-mobile-unit-21-w-x-78-h-brushed-graphite>: HTTP status code is not handled or not allowed
2026-01-10 19:20:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-elements-mobile-starter-unit-18-w-x-48-l-x-70-h-4-shelf-4-premium-casters-brushed-graphite->: HTTP status code is not handled or not allowed
2026-01-10 19:20:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/male-adapter-6mm-straight-x-1-8-bspp>: HTTP status code is not handled or not allowed
2026-01-10 19:20:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-workbench-2-3-4-backsplash-galv-steel-undershelf-72-w-x-30-d>: HTTP status code is not handled or not allowed
2026-01-10 19:20:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-male-elbow-1-4-tube-x-1-8-pt>: HTTP status code is not handled or not allowed
2026-01-10 19:21:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-male-elbow-5-32-tube-x-1-4-pt>: HTTP status code is not handled or not allowed
2026-01-10 19:21:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flow-control-8mm-tube-x-3-8-metal-release-collet-flow-out-screw-adjustment>: HTTP status code is not handled or not allowed
2026-01-10 19:21:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electronic-depth-gage-2-31-64-inch-base-length-0-12-inch-0-300mm-range>: HTTP status code is not handled or not allowed
2026-01-10 19:21:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reverse-reading-dial-indicator-flat-back-0-1-inch-range>: HTTP status code is not handled or not allowed
2026-01-10 19:21:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ninja-series-planetary-gear-winch-w-synthetic-rope-4500-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:21:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shield-octagonal-direct-mount-w-interlock-led-24-inch-l-x-10-inch-w>: HTTP status code is not handled or not allowed
2026-01-10 19:21:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shield-flat-direct-mount-w-interlock-7-inch-w-x-6-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 19:21:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ecp-industrial-dispenser-60-inch-l>: HTTP status code is not handled or not allowed
2026-01-10 19:21:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13268 pages (at 94 pages/min), scraped 5584 items (at 44 items/min)
2026-01-10 19:21:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ecp-heavy-duty-kit-for-5-8-inch-polypropylene-strap>: HTTP status code is not handled or not allowed
2026-01-10 19:21:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-cone-corner-plastic-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:21:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/af-hepa-filter-merv-17-5-14w-x-9d-x-1-12h>: HTTP status code is not handled or not allowed
2026-01-10 19:21:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbw-antimicrobial-vinyl-basket-truck-w-bumper-18-bushel-capacity-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/bulk_container_trucks_tilt_trucks/basket_trucks/vinyl_basket_trucks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbw-vinyl-bumper-truck-2-rigid-2-swivel-casters-18-bushel-capacity-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:21:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vaccuum-breaker-hp>: HTTP status code is not handled or not allowed
2026-01-10 19:21:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aquasense-single-hole-sensor-faucet-with-0-5-gpm-aerator-6-vdc-plug-in-converter-mixing-valve>: HTTP status code is not handled or not allowed
2026-01-10 19:21:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glennville-lounge-chair-coastal-nantucket-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:21:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pinehurst-chaise-lounge-white>: HTTP status code is not handled or not allowed
2026-01-10 19:21:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cape-coral-gold-lines-slab-door-wood-30w-x-80h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-wide-jamb-white>: HTTP status code is not handled or not allowed
2026-01-10 19:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-jamb-ice-maple>: HTTP status code is not handled or not allowed
2026-01-10 19:21:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arcadia-glazed-light-slab-door-wood--glass-28w-x-80h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:21:25 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/carts-trucks/bulk_container_trucks_tilt_trucks/basket_trucks/vinyl_basket_trucks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/carts-trucks/bulk_container_trucks_tilt_trucks/basket_trucks/vinyl_basket_trucks landed on page that is not a product page.
2026-01-10 19:21:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ocala-gold-lines-slab-door-wood-32w-x-80h-ice-maple>: HTTP status code is not handled or not allowed
2026-01-10 19:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gainesville-silver-lines-slab-door-wood-24w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 19:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-west-night-lines-slab-door-wood-24w-x-80h-ice-maple>: HTTP status code is not handled or not allowed
2026-01-10 19:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pensacola-glazed-light-slab-door-wood--glass-28w-x-80h-ice-maple>: HTTP status code is not handled or not allowed
2026-01-10 19:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/door_window_hardware/door_plates_braces already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/privacy-pocket-lock-nickel>: HTTP status code is not handled or not allowed
2026-01-10 19:21:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors>: HTTP status code is not handled or not allowed
2026-01-10 19:21:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/doors_windows/doors/interior-doors>: HTTP status code is not handled or not allowed
2026-01-10 19:21:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hog-heavenanti-fatigue-mat-58-thick-40l-x-4w-black-striped-border>: HTTP status code is not handled or not allowed
2026-01-10 19:21:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hog-heavenanti-fatigue-mat-78-thick-25l-x-3w-black-striped-border>: HTTP status code is not handled or not allowed
2026-01-10 19:21:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polywoven-dunnage-air-bags-4-ply-102l-x-46-12w-pack-of-180>: HTTP status code is not handled or not allowed
2026-01-10 19:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/espresso-maker-10-cups-stainless-steel-matte-black>: HTTP status code is not handled or not allowed
2026-01-10 19:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roast-ground-coffee-classico-arabica-medium-blend-2-lb-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 19:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-supplies/doors_windows/doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavyweight-teaspoon-crystal-clear-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 19:21:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/fasteners/door_window_hardware/door_plates_braces>: HTTP status code is not handled or not allowed
2026-01-10 19:21:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coffee-filters-w-flat-bottom-12-cups-pack-of-3000>: HTTP status code is not handled or not allowed
2026-01-10 19:21:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-coffee-creamer-salted-caramel-chocolate-0-38-oz-mini-cups-pack-of-200>: HTTP status code is not handled or not allowed
2026-01-10 19:21:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smartlock-container-w-3-compartment-9-l-x-9-w-x-3-1-8-h-pack-of-120>: HTTP status code is not handled or not allowed
2026-01-10 19:21:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durable-packaging-aluminum-steam-table-pans-79-5-oz-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:21:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/doors_windows/doors>: HTTP status code is not handled or not allowed
2026-01-10 19:21:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/doors_windows/doors>: HTTP status code is not handled or not allowed
2026-01-10 19:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/foodservice_disposables/disposable_cups already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:21:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/building-supplies/doors_windows/doors>: HTTP status code is not handled or not allowed
2026-01-10 19:21:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conex-cold-drink-cups-10-oz-polystyrene-clear-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:21:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spiral-wound-paper-hot-cup-lids-for-16-oz-cups-white-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 19:21:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foam-food-container-squat-white-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 19:21:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mopping-tools-w-aluminum-base-for-18-20-pads-blue-12case>: HTTP status code is not handled or not allowed
2026-01-10 19:21:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rear-handle-circular-saw-bare-tool-only-7-14-dia-24v>: HTTP status code is not handled or not allowed
2026-01-10 19:21:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stereoblue-binocular-zoom-microscope-w-ergonomic-stand-led-illumination-7x-to-45x>: HTTP status code is not handled or not allowed
2026-01-10 19:21:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-boltless-steel-shelf-48-in-w-x-18-in-d>: HTTP status code is not handled or not allowed
2026-01-10 19:21:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blood-bank-refrigerator-w-chart-recorder-23-cuft-cap-glass-door>: HTTP status code is not handled or not allowed
2026-01-10 19:21:57 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/foodservice/foodservice_disposables/disposable_cups> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/foodservice/foodservice_disposables/disposable_cups landed on page that is not a product page.
2026-01-10 19:21:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-visibility-windbreaker-water-resistant-jacket-type-r-class-3-lime-medium>: HTTP status code is not handled or not allowed
2026-01-10 19:21:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curad-performance-ironman-adjustable-knee-support-universal-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:22:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curad-lace-up-ankle-splint-figure-8-retail-packaging-large>: HTTP status code is not handled or not allowed
2026-01-10 19:22:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-instant-hot-pack-8l-x-6w-pack-of-24>: HTTP status code is not handled or not allowed
2026-01-10 19:22:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardian-k3-wheelchair-w-height-adj-desk-length-arms-swing-away-footrests-18w-seat>: HTTP status code is not handled or not allowed
2026-01-10 19:22:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carbon-fiber-rollator-w-regular-seat-16-12w-x-24h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:22:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zip-style-biohazard-specimen-bag-w-pocket-6-x-9-1000-per-pack10-packs-per-case>: HTTP status code is not handled or not allowed
2026-01-10 19:22:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prescription-vial-w-reversible-cap-40-dram-amber-pack-of-160>: HTTP status code is not handled or not allowed
2026-01-10 19:22:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curad-compression-hosiery-w-15-20-mmhg-knee-high-3x-large-size-f-regular-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:22:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duocare-oral-care-self-care-caddy-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:22:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13356 pages (at 88 pages/min), scraped 5618 items (at 34 items/min)
2026-01-10 19:22:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/disinfecting-wipes-bucket-lemon--lime-blossom-800-wipesbucket-2-bucketscarton>: HTTP status code is not handled or not allowed
2026-01-10 19:22:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vision-type-v-protection-safety-eyewear-smoky-lens-gray-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:22:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipe-cradle-truck-w-pneumatic-casters-1200-lb-cap-57-7-8l-x-34-3-16w-x-36h>: HTTP status code is not handled or not allowed
2026-01-10 19:22:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oem-washergasket-set-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 19:22:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-two-handle-faucet-w-10-spout>: HTTP status code is not handled or not allowed
2026-01-10 19:22:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/77-5505-wide-spread-faucet-w-pop-up-medium-arc-spout-12-gpm-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 19:22:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/studio-dumbbell-rack-27w-x-31d-x-50h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:22:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-ball-16-lb>: HTTP status code is not handled or not allowed
2026-01-10 19:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/seating/reception_sofas_sectionals already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:22:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/business-furniture-coventry-sofa-85-1-16w-x-33-7-16d-x-35-3-4h-beige>: HTTP status code is not handled or not allowed
2026-01-10 19:22:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/countertop-microwave-1000-watts-11-cuft-capacity-black-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:22:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contemporary-classic-chrome-refrigerator-11-cuft-capacity-midnight-black>: HTTP status code is not handled or not allowed
2026-01-10 19:22:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sub-compact-brushless-cordless-combo-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:22:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/western-global-251-gallon-transcube-gasoline-transportable-fuel-storage-tank-emergency-vent-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:22:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-in-l-ball-transfer-table-21-in-w-between-frame-3-in-ball-center>: HTTP status code is not handled or not allowed
2026-01-10 19:22:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-w-fixed-shelves-assembled-48w-x-24d-x-72h-navy-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:22:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-w-fixed-shelves-assembled-36w-x-24d-x-72h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:22:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/seating/reception_sofas_sectionals>: HTTP status code is not handled or not allowed
2026-01-10 19:22:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bookcase-assembled-36w-x-18d-x-60h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:22:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screw-cap-microtube-w-o-ring-sterile-2-ml-capacity-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 19:22:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-premium-heavy-duty-vest-w-multi-pockets-4xl5xl-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:22:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-diamond-quilted-jacket-w-removable-hood-black-large>: HTTP status code is not handled or not allowed
2026-01-10 19:22:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-tone-short-sleeve-polo-shirt-w-1-pocket-class-3-polyester-lime-l>: HTTP status code is not handled or not allowed
2026-01-10 19:22:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quartz-duck-sherpa-lined-heavy-weight-jacket-brown-5xl>: HTTP status code is not handled or not allowed
2026-01-10 19:22:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onyx-standard-safety-vest-w-black-contrasting-trim-class-2-2xl-lime>: HTTP status code is not handled or not allowed
2026-01-10 19:22:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/friedrich--thru-the-wall-air-conditioner-1130-watts-230-v-12000-btu>: HTTP status code is not handled or not allowed
2026-01-10 19:22:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-wagon-truck-w-lip-deck-3500-lb-capacity-36l-x-24w-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:22:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-shelf-truck-2-handle-3600-lb-capacity-59l-x-24w-x-34h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:22:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-class-2-hi-vis-safety-vest-2-pockets-mesh-lime-4xl-5xl>: HTTP status code is not handled or not allowed
2026-01-10 19:22:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chill-its-6668-hi-vis-safety-cooling-vest-class-2-small-lime>: HTTP status code is not handled or not allowed
2026-01-10 19:22:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-860-heavy-lifting-utility-gloves-medium-black>: HTTP status code is not handled or not allowed
2026-01-10 19:22:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-7022-cut-resistant-gloves-dsx-coated-ansi-a2-xl-lime-144-pairs>: HTTP status code is not handled or not allowed
2026-01-10 19:22:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-7022-cut-resistant-gloves-dsx-coated-ansi-a2-m-lime-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 19:22:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8291bk-hi-vis-long-sleeve-t-shirt-type-r-class-2-s-lime>: HTTP status code is not handled or not allowed
2026-01-10 19:22:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arsenal-5974-hoist-bucket-tool-bag-w-swivelling-carabiner--zipper-large-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:22:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz174-odin-anti-fog-safety-glasses-clear-lens-kryptek-highlander-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:22:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8379-hi-vis-3-in-1-winter-bomber-jacket-xl-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:22:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-air-impact-wrench-2750-ft-lbs-torque-super-duty-pistol-grip-titanium-hammercase>: HTTP status code is not handled or not allowed
2026-01-10 19:22:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-drill-reversible-roll-throttle-300-rpm-3hp-no-3-morse-taper>: HTTP status code is not handled or not allowed
2026-01-10 19:22:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-aerospace-riveter-1-78-stroke-3200-bpm-06-bore>: HTTP status code is not handled or not allowed
2026-01-10 19:22:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/17mm-metric-hex-deep-powersocket-for-ingersoll-rand-12in-drive-tool>: HTTP status code is not handled or not allowed
2026-01-10 19:22:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-tier-1-door-digital-locker-12in-w-x-12in-d-x-78in-h-blue-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:23:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-bench-perforated-seat-surface-mount-6l-black>: HTTP status code is not handled or not allowed
2026-01-10 19:23:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chest-freezer-30176c-10-cu-ft-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 19:23:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drive-belt-for-hl-m810-band-sealer>: HTTP status code is not handled or not allowed
2026-01-10 19:23:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impresse-horizontal-band-sealer-w-right-feed--dry-ink-coding-20mm-seal-width>: HTTP status code is not handled or not allowed
2026-01-10 19:23:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-black-oxide-drill-bit-316-dia>: HTTP status code is not handled or not allowed
2026-01-10 19:23:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tough-coat-adv-spray-paint-w-rust-barrier-technology-20-oz-cap-flat-black>: HTTP status code is not handled or not allowed
2026-01-10 19:23:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-degree-cone-bur-double-cut-2l-x-316-shank-dia>: HTTP status code is not handled or not allowed
2026-01-10 19:23:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guidepoint-drywall-zipbit-18-bit-dia-pack-of-16>: HTTP status code is not handled or not allowed
2026-01-10 19:23:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wallet-pouch-bur-set-aluma-cut-powerz-finish-14-shank-dia-set-of-4>: HTTP status code is not handled or not allowed
2026-01-10 19:23:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13452 pages (at 96 pages/min), scraped 5664 items (at 46 items/min)
2026-01-10 19:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/led_bulbs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:23:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t5-led-tube-light-bulb-miniature-bi-pin-base-18w-2100-lumens-3000k-warm-white>: HTTP status code is not handled or not allowed
2026-01-10 19:23:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-crystal-wall-sconce-light-fixture-10w-800-lumens-80-cri-12-size-black>: HTTP status code is not handled or not allowed
2026-01-10 19:23:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-commercial-square-bollard-outdoor-light-fixture-121622w-2800-lumens-bronze>: HTTP status code is not handled or not allowed
2026-01-10 19:23:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/incu-shaker-10lr-w-non-slip-rubber-mat-230v-5060-hz-30-300-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:23:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/biomixer-3d-nutating-shaker-w-dimpled-mat-230v-5060-hz-20-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:23:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roto-mini-plus-rotator-w-tube-holders-230v-5060-hz-5-70-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:23:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-king-sk2000-pallet-load-stop-beam-3-or-4-setback-w-same-clip-108w-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:23:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tread-plate-deck-platform-truck-aluminum-6-polyurethane-caster-75l-x-36w-2600-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:23:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/light_bulbs_lamps/led_bulbs>: HTTP status code is not handled or not allowed
2026-01-10 19:23:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala174-smart-lock-self-retracting-lifeline-stainless-steel-cable-480l>: HTTP status code is not handled or not allowed
2026-01-10 19:23:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xl48-box-sentinel-front-loader-solar-powered-cabinet-26w-x-50dx-44h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:23:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-starter-48l-x-36w-x-96h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:23:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-unit-w-t-joiner-support-clip-36l-x-12w-x-60h-antique-white>: HTTP status code is not handled or not allowed
2026-01-10 19:23:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-gas-to-lp-conversion-kit-for-200000-btu-unit-heaters>: HTTP status code is not handled or not allowed
2026-01-10 19:23:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-flex-ii-vinyl-bulk-roll-smooth-24-x-160-x-30-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:23:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mmb-yb12a-a-12v-12ah-165-cca-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:23:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz-dagr-afas-half-frame-safety-glasses-clear-lens-matte-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:23:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/identification-tag-4-inch-x-2-inch-gray-37083>: HTTP status code is not handled or not allowed
2026-01-10 19:23:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobilecare-drawer-divider-for-23w-drawers-23l-x-18w-x-6h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:23:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-3-bar-steel-ladder-roof-rack-for-nissan-nv-cargo-van-2011-on-white>: HTTP status code is not handled or not allowed
2026-01-10 19:23:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-2-bar-steel-ladder-roof-rack-for-ram-promaster-city-2014-on-white>: HTTP status code is not handled or not allowed
2026-01-10 19:23:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-containment-wall-m2-complete-systems-18632-gal-cap-180l-x-668w-x-36h>: HTTP status code is not handled or not allowed
2026-01-10 19:23:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-3-bar-steel-ladder-roof-rack-for-ford-transit-connect-2014-on-black>: HTTP status code is not handled or not allowed
2026-01-10 19:23:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-swivel-anchor>: HTTP status code is not handled or not allowed
2026-01-10 19:23:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polytec153-recycling-container-w-riverstone-panels-42-gal-cap-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:23:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80b20hx1mpb-1-pitch-1-plain-bore-20-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:23:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patch-seal-paste-1-lb-capacity-white-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 19:23:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultimate-spray-adhesive-122-oz-capacity-clear-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 19:23:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100bs40x2-1-14-pitch-2-finished-bore-40-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:23:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-20bs12hx42-metric-1-14-pitch-42mm-finished-bore-12-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:23:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-orange-pumice-hand-cleaner-citrus-0-5-gal-pump-bottle-4-carton>: HTTP status code is not handled or not allowed
2026-01-10 19:23:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-16bs22x40-metric-1-pitch-40mm-finished-bore-22-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:23:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs18hx2-1-pitch-2-finished-bore-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:23:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/groundbreaker-pull-on-boots-composite-toe-size-7w-11-inch-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:23:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scrubbing-towels-hand-cleaning-orange-scent-white-yellow-170-bucket-2-buckets-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:23:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-safety-crafted-waterproof-logger-work-boots-steel-toe-size-14w-8-inch-h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:23:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100bs23hx1716-1-14-pitch-1-716-finished-bore-23-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:23:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-paddle-cover-for-18-paddle-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:23:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-safety-crafted-waterproof-logger-work-boots-steel-toe-size-13-5m-8-inch-h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:23:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs30x178-1-pitch-1-78-finished-bore-30-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:23:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs16hx70-metric-1-12-pitch-70mm-finished-bore-16-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:23:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-high-top-sneaker-composite-toe-size-7m-black-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:23:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots landed on page that is not a product page.
2026-01-10 19:24:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-men-s-low-cut-sneaker-composite-toe-size-11w-gray-black>: HTTP status code is not handled or not allowed
2026-01-10 19:24:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots>: HTTP status code is not handled or not allowed
2026-01-10 19:24:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots>: HTTP status code is not handled or not allowed
2026-01-10 19:24:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-16bs13hx38-metric-1-pitch-38mm-finished-bore-13-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:24:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_boots>: HTTP status code is not handled or not allowed
2026-01-10 19:24:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steri-drape-wound-edge-protector-1074-35-inch-x-35-inch-6-5-8-inch-ring-diameter-10-bx-4-bx-cs>: HTTP status code is not handled or not allowed
2026-01-10 19:24:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-boltless-shelving-72-in-w-x-24-in-d-x-84-in-h-5-shelves-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:24:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truflex-fly-skylar-sneaker-composite-toe-size-5m-black>: HTTP status code is not handled or not allowed
2026-01-10 19:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:24:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13544 pages (at 92 pages/min), scraped 5705 items (at 41 items/min)
2026-01-10 19:24:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vitals-skate-inspired-work-shoes-composite-toe-size-8-5m-wintermoss-whitecap-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:24:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40bs19hx1716-12-pitch-1-716-finished-bore-19-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:24:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vitals-skate-inspired-work-shoes-composite-toe-size-9-5w-navy-aged-indigo>: HTTP status code is not handled or not allowed
2026-01-10 19:24:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vitals-skate-inspired-work-shoes-composite-toe-size-8m-navy-aged-indigo>: HTTP status code is not handled or not allowed
2026-01-10 19:24:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-08a35h-metric-a-plate-12-pitch-15mm-bore-35-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:24:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-fraction-collector-tube-rack-for-1-5-ml-2-ml-tubes-80-place-blue-5-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:24:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs16hx1716-58-pitch-1-716-finished-bore-16-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:24:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs18hx60-metric-1-12-pitch-60mm-finished-bore-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:24:20 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 19:24:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/true-skate-inspired-work-shoes-composite-toe-size-13m-black-gum>: HTTP status code is not handled or not allowed
2026-01-10 19:24:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/true-skate-inspired-work-shoes-composite-toe-size-10m-black-gum>: HTTP status code is not handled or not allowed
2026-01-10 19:24:22 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 19:24:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/true-skate-inspired-work-shoes-composite-toe-size-9w-black>: HTTP status code is not handled or not allowed
2026-01-10 19:24:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-readystrain-sterile-cell-straining-kit-100um-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/belt_stanchions already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:24:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-legend-800-800cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:24:26 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 19:24:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60btl13h-taper-bushed-34-pitch-13-teeth-13-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:24:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apc-rbc2-ups-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:24:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-skate-inspired-work-shoes-composite-toe-size-5-5m-blue-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:24:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs33hx118-38-pitch-1-18-finished-bore-33-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:24:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs38x1716-1-pitch-1-716-finished-bore-38-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:24:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-crafted-western-work-boots-w-steel-toe-and-internal-met-guard-size-8w-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:24:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foam-pouches-3-x-5-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:24:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-bags-3-x-5-2-mil-white-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:24:35 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/belt_stanchions> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/belt_stanchions landed on page that is not a product page.
2026-01-10 19:24:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premier-work-casual-oxford-shoes-steel-toe-size-7-5d-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:24:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bubble-bags-4-x-5-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:24:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 19:24:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes>: HTTP status code is not handled or not allowed
2026-01-10 19:24:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bubble-bags-4-x-6-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:24:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanoflex-tr-athletic-work-shoes-composite-toe-size-5-5m-black-camo-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:24:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-op-art-skate-inspired-work-shoes-composite-toe-size-11w-dark-gray-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 19:24:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r-d-5269-sealed-lead-acid-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:24:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bubble-bags-4-x-8-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:24:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanoflex-tr-athletic-work-shoes-composite-toe-size-6m-black-camo-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:24:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-twine-2-ply-315-lb-4200>: HTTP status code is not handled or not allowed
2026-01-10 19:24:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/i-beam-trolley-anchor-for-beams-from-3-10-and-up-to-7-8-thick>: HTTP status code is not handled or not allowed
2026-01-10 19:24:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-5w-silver-army-green-pink>: HTTP status code is not handled or not allowed
2026-01-10 19:24:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severance-hss-6-flute-chatterless-countersink-1-2-diameter-90-degree>: HTTP status code is not handled or not allowed
2026-01-10 19:24:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ledr001-17-led-ceiling-fixtures-35w-4000-cct-2900-lumens-82-cri-nickel>: HTTP status code is not handled or not allowed
2026-01-10 19:24:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-maxim3-alarm-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:24:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-ingredient-bin-148bin-yw-14-5-8-l-x-9-1-4-w-x-23-1-4-h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:24:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-pocket-sharpener-steel-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:24:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/980-electric-hydraulic-pump-with-pendant>: HTTP status code is not handled or not allowed
2026-01-10 19:24:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-smp7pmp4-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:25:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ls50l11b-battery-powered-knockout-punch-driver-tool-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:25:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-al600ulm-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:25:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simplex-2081-9272-alarm-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:25:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-08bs14hx25-metric-12-pitch-25mm-finished-bore-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:25:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rb3315-nanoflex-tr-athletic-work-shoes-composite-toe-size-15m-black>: HTTP status code is not handled or not allowed
2026-01-10 19:25:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-25b22hx14mpb-14-pitch-14-plain-bore-22-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:25:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40b13hx12mpb-12-pitch-12-plain-bore-13-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:25:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bruno-34-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:25:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ag10-series-4-x-36-solid-alum-fixed-bar-supply-return-air-vent-grille-brushed-satin>: HTTP status code is not handled or not allowed
2026-01-10 19:25:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13636 pages (at 92 pages/min), scraped 5743 items (at 38 items/min)
2026-01-10 19:25:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs23x2716-1-pitch-2-716-finished-bore-23-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:25:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lavante-trail-2-running-work-shoes-composite-toe-size-15w-army-green-black-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:25:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ctm-hs-685-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:25:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40bs14hx58-12-pitch-58-finished-bore-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 19:25:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-high-top-work-shoes-composite-toe-size-3w-triple-black>: HTTP status code is not handled or not allowed
2026-01-10 19:25:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mounted-work-station-with-foldable-keyboard-tray>: HTTP status code is not handled or not allowed
2026-01-10 19:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:25:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/column-protector-for-24-dia-concrete-columns-44w-x-42h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:25:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-reflective-strap-100l-x-2w-set-of-2>: HTTP status code is not handled or not allowed
2026-01-10 19:25:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-powered-straddle-stacker-2200-lb-cap-116-lift-987198>: HTTP status code is not handled or not allowed
2026-01-10 19:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:25:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/murray-36519-lawn-and-garden-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:25:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotary-screw-air-compressor-wdryer-230v-115-psi-55-cfm-15hp-3ph>: HTTP status code is not handled or not allowed
2026-01-10 19:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:25:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/can-am-quest-opt-500cc-atv-replacement-battery-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 19:25:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-work-shoes-composite-toe-size-13w-olive-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:25:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teledyne-b6-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:25:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-work-shoes-composite-toe-size-12m-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:25:28 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers landed on page that is not a product page.
2026-01-10 19:25:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-work-shoes-composite-toe-size-9w-olive-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:25:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-drum-spillpallet-5400-bd-eco-solutions-2000-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:25:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-work-shoes-composite-toe-size-12w-olive-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:25:31 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/foot_protection/safety_toe_work_shoes landed on page that is not a product page.
2026-01-10 19:25:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-work-shoes-composite-toe-size-11-5w-olive-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:25:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-dcp31-23-gy-drawer-pedestal-w23-long-drawers-15-12w-x-30d-x-30-14h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:25:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-work-shoes-composite-toe-size-7m-rust>: HTTP status code is not handled or not allowed
2026-01-10 19:25:34 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats landed on page that is not a product page.
2026-01-10 19:25:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-sump-pump-replacement-battery-100ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:25:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-traxter-optional-500cc-atv-replacement-battery-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 19:25:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-channel-2-heavy-duty-cable-guard-orange-black>: HTTP status code is not handled or not allowed
2026-01-10 19:25:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/46-ada-round-expanded-metal-picnic-table-green>: HTTP status code is not handled or not allowed
2026-01-10 19:25:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comfortie-casual-work-shoes-steel-toe-size-11-5m-black-white>: HTTP status code is not handled or not allowed
2026-01-10 19:25:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-slide-base-w364t>: HTTP status code is not handled or not allowed
2026-01-10 19:25:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/25u-4-post-open-frame-rack-cabinet-square-holes-1000lb-capacity-sr4post25>: HTTP status code is not handled or not allowed
2026-01-10 19:25:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lyra-color-giants-skin-tone-colored-pencils-63-mm-lead-size-assorted-lead-12-set>: HTTP status code is not handled or not allowed
2026-01-10 19:25:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tgb-r50x-50cc-scooter-and-moped-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:25:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peugeot-trekker-100cc-scooter-and-moped-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:25:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/healthflex-privacy-screen-5-panel-vinyl-ice>: HTTP status code is not handled or not allowed
2026-01-10 19:25:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pm-dc-motor-wpmdc12-18-24v-56cb-tenv-tefc-56c-24v-1-2-hp-1800-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:25:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pm-dc-motor-wpmdc1-18-90v-56cb-tenv-tefc-56c-90v-1-hp-1800-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:25:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-wire-security-partition-bolt-on-clips-kit-black>: HTTP status code is not handled or not allowed
2026-01-10 19:25:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1159630-offset-door-pull-19x1x312-18ctc-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:25:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polaris-ranger-570-4-crew-570cc-utv-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/three_phase_motors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:25:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-wire-security-partition-panel-4w-x-4h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:25:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-wire-security-partition-slide-door-8w-x-8h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:25:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/170-industrial-carton-sealing-tape-3-x-110-yds-tan-pack-of-24>: HTTP status code is not handled or not allowed
2026-01-10 19:25:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-foot-shin-guards-steel-toe-clip-leather-strap-5w-standard-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 19:25:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-metal-foot-guards-rubber-toe-clip-leather-strap-6w-extra-large-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 19:25:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hs-9070-01-mens-handicap-ada-sign-6-x-9-blue-with-raised-white-lettering>: HTTP status code is not handled or not allowed
2026-01-10 19:25:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-red-plastic-tilt-truck-1-cubic-yard-1250-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:25:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tripp-lite-su2200rtxl2un-ups-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:26:00 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/three_phase_motors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/three_phase_motors landed on page that is not a product page.
2026-01-10 19:26:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-100-1000-gigabit-multimode-fiber-media-converter-rj45-sc>: HTTP status code is not handled or not allowed
2026-01-10 19:26:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kontron-kaat-ii-plus-medical-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:26:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/obrien-kmi-gemini-2-medical-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:26:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-rated-fire-extinguisher-cabinet-full-acrylic-window-saf-t-lok-semi-recessed-6d-4-rolled>: HTTP status code is not handled or not allowed
2026-01-10 19:26:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calculating-time-clock-gray-mjr-7000-1167>: HTTP status code is not handled or not allowed
2026-01-10 19:26:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-lp12-1-5-sealed-lead-acid-replacement-battery-1-3ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:26:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-yellow-wall-mount-hdmw>: HTTP status code is not handled or not allowed
2026-01-10 19:26:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/75-nonslip-coating-durable-antislip-paint-1-gal-orange-75-or-gl>: HTTP status code is not handled or not allowed
2026-01-10 19:26:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13728 pages (at 92 pages/min), scraped 5778 items (at 35 items/min)
2026-01-10 19:26:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scheduled-maintenance-kit-for-liquid-cooled-generators-with-42-lt-engines>: HTTP status code is not handled or not allowed
2026-01-10 19:26:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-built-ii153-3-tier-3-doors-locker-12w-x-12d-x-82h-black-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:26:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bruno-outdoor-straight-stairlift-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:26:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-ft-50-amp-generator-cord-with-nema-14-50-male-and-locking-female>: HTTP status code is not handled or not allowed
2026-01-10 19:26:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-built153-2-tier-6-doors-locker-36w-x-12d-x-78h-light-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:26:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-level-drum-alarm-polypropylene-threaded-plug-5-working-depth-w-feed-pipe-1>: HTTP status code is not handled or not allowed
2026-01-10 19:26:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apc-back-ups-600-bn600-12v-9ah-ups-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:26:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powered-drum-truck-f89484c-cable-chime-hook-12-wheels>: HTTP status code is not handled or not allowed
2026-01-10 19:26:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mk-es17-12-sealed-lead-acid-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:26:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-extra-heavy-duty-additional-shelf-48w-x-12d-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:26:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calm63-501-56c-aluminum-worm-gear-reducer-63mm-501-56c-nema-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:26:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/haze-hzs6-7-2-sealed-lead-acid-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:26:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-step-heavy-duty-double-entry-work-platform-24w-steps-dep5-2472>: HTTP status code is not handled or not allowed
2026-01-10 19:26:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calm75-opc-output-cover-for-calm-series-75mm-aluminum-worm-gear-reducer>: HTTP status code is not handled or not allowed
2026-01-10 19:26:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/excel-eb12220-sealed-lead-acid-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:26:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-style-deep-bin-shelving-11-shelves-add-on-unit-36w-x-72d-x-87h-bluegray>: HTTP status code is not handled or not allowed
2026-01-10 19:26:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-products-mt-tt-1416-utility-trailer-mesh-cover-14x16>: HTTP status code is not handled or not allowed
2026-01-10 19:26:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-purpose-e-track-tie-down-strap-4400-lb-capacity-2-x-12>: HTTP status code is not handled or not allowed
2026-01-10 19:26:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-closed-stand-alone-shelving-5-shelves-375-lb-cap-48w-x-18d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:26:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-purpose-e-track-tie-down-strap-4400-lb-capacity-2-x-12-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 19:26:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-in-x-20-in-steel-door-louver>: HTTP status code is not handled or not allowed
2026-01-10 19:26:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-products-mn-dn-1218-debris-safety-netting-12-x-18>: HTTP status code is not handled or not allowed
2026-01-10 19:26:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fiamm-12fgl80-sealed-lead-acid-replacement-battery-75ah-12v-it>: HTTP status code is not handled or not allowed
2026-01-10 19:26:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-lp12-26-lp-12-26-12v-26ah-emergency-light>: HTTP status code is not handled or not allowed
2026-01-10 19:26:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-closed-stand-alone-shelving-5-shelves-800-lb-cap-36w-x-24d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:26:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cove-base-vinyl-4x080x48-blackbrown>: HTTP status code is not handled or not allowed
2026-01-10 19:26:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b-b-bp17-12-nb-sealed-lead-acid-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:26:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-track-dolly-connector-tie-down-strap-4400-lb-capacity-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 19:26:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/national-nb4-10-sealed-lead-acid-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:26:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-sonic-ps-12180-nb-ps12180-12v-18ah-emergency-light>: HTTP status code is not handled or not allowed
2026-01-10 19:26:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-8-inch-dia-hss-half-round-jobber-drill>: HTTP status code is not handled or not allowed
2026-01-10 19:26:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/firstpower-fp665-sealed-lead-acid-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:26:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fast-track-e-track-horizontal-vertical-anchor-track-16-galvanized-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:26:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gallagher-solar-fence-industrial-replacement-battery-8ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:26:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-coupler-lock-rekeyable-cylinder-fits-1-78-2-2-516>: HTTP status code is not handled or not allowed
2026-01-10 19:26:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/access-axs5020-sealed-lead-acid-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:26:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-djw12-14-sealed-lead-acid-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/plumbing/plumbing_fittings/pipe_clamps_fittings/black_malleable_pipe_fittings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:26:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cryo-vial-sterile-round-base-45ml-capacity-clear-pack-of-250>: HTTP status code is not handled or not allowed
2026-01-10 19:26:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-push-beam-trolley-5-ton-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:26:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dynamometer-top-hook-assembly-for-1-12-ton-capacity-lever-hoists>: HTTP status code is not handled or not allowed
2026-01-10 19:26:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-2-in-3-in-black-steel-pipe-nipple-150-psi-lead-free>: HTTP status code is not handled or not allowed
2026-01-10 19:26:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-in-close-black-steel-pipe-nipple-150-psi-lead-free>: HTTP status code is not handled or not allowed
2026-01-10 19:26:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-smp3pmctxpd16cb-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:26:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vision-6fm60d-x-sealed-lead-acid-replacement-battery-75ah-12v-it>: HTTP status code is not handled or not allowed
2026-01-10 19:26:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duracell-sla6-5f-sealed-lead-acid-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:26:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/plumbing/plumbing_fittings/pipe_clamps_fittings/black_malleable_pipe_fittings>: HTTP status code is not handled or not allowed
2026-01-10 19:26:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-knee-elbow-bandages-adhesive-breathable-latex-free-4l-x-188w-8-pk-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:27:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-manual-chain-hoist-5-ton-capacity-30-lift>: HTTP status code is not handled or not allowed
2026-01-10 19:27:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microfiber-cloths-16x16-yellow-200-pack-csa008e>: HTTP status code is not handled or not allowed
2026-01-10 19:27:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teftec-alpha-trac-wheelchair-replacement-battery-75ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:27:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shepard-meyra-967-wheelchair-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:27:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glacier-basic-acoustical-panels-shadowline-edge-24l-x-24w-white>: HTTP status code is not handled or not allowed
2026-01-10 19:27:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orleans-3-piece-outdoor-patio-set>: HTTP status code is not handled or not allowed
2026-01-10 19:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/lift_tables_work_positioners/stationary_lift_tables already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:27:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reagent-bottle-wide-mouth-hdpe-125ml-capacity-clear-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 19:27:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13827 pages (at 99 pages/min), scraped 5822 items (at 44 items/min)
2026-01-10 19:27:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transparent-plastic-shim-coil-0075-10-20>: HTTP status code is not handled or not allowed
2026-01-10 19:27:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/63092rs-p53-deep-groove-ball-bearing-double-sealed-abec-5-45mm-bore-100mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:27:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergency-cubicle-shower-w-multi-nozzle-body-eye-face-wash-floor-mount-30-gpm>: HTTP status code is not handled or not allowed
2026-01-10 19:27:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clean-room-acoustical-panels-square-edge-24l-x-48w-white>: HTTP status code is not handled or not allowed
2026-01-10 19:27:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/63082rs-deep-groove-ball-bearing-double-sealed-40mm-bore-90mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:27:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6320-deep-groove-ball-bearing-open-100mm-bore-215mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:27:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nessler-cylinder-rack-for-50ml-tubes-pp-6-tubes-white>: HTTP status code is not handled or not allowed
2026-01-10 19:27:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/630082rs-deep-groove-ball-bearing-wide-width-double-sealed-40mm-bore-68mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:27:18 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/material-handling/lift_tables_work_positioners/stationary_lift_tables> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/material-handling/lift_tables_work_positioners/stationary_lift_tables landed on page that is not a product page.
2026-01-10 19:27:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wash-bottle-unitary-ldpe-125ml-capacity-white-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 19:27:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teardrop-bolted-pallet-rack-starter-108w-x-48d-x-96h>: HTTP status code is not handled or not allowed
2026-01-10 19:27:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62042rs-deep-groove-ball-bearing-double-sealed-20mm-bore-47mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:27:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pneumatic-vibrator-s-30-ball-anodized-aluminum-body>: HTTP status code is not handled or not allowed
2026-01-10 19:27:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62142rsnr-deep-groove-ball-bearing-double-sealed-snap-ring-70mm-bore-125mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:27:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-tier-12-door-wood-locker-36-w-x-15-d-x-72-h-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:27:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pneumatic-vibrator-turbine-ot-10-anodized-aluminum-body>: HTTP status code is not handled or not allowed
2026-01-10 19:27:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-tier-2-door-wood-locker-12-w-x-15-d-x-72-h-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:27:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-tier-4-door-digital-wood-locker-12-w-x-15-d-x-72-h-cherry-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:27:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permobil-chairman-hd-wheelchair-replacement-battery-75ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:27:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-electric-vibrator-mve-23004-1800rpm-3-phase-60hz-230460v-4pole>: HTTP status code is not handled or not allowed
2026-01-10 19:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/ladders_personnel_lifts/step_ladders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:27:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62052rs-deep-groove-ball-bearing-double-sealed-25mm-bore-52mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:27:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6307zz-deep-groove-ball-bearing-double-shielded-35mm-bore-80mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:27:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ticonderoga-woodcase-hb-2-pencil-with-latexfree-eraser-96pack>: HTTP status code is not handled or not allowed
2026-01-10 19:27:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-54l-x-18w-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:27:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gilson-16eh-yard-lawn-and-garden-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:27:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60440212078-cloth-belt-340d-37w-x-60l-p120-grit>: HTTP status code is not handled or not allowed
2026-01-10 19:27:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desk-highlighter-chisel-tip-fluorescent-green-ink>: HTTP status code is not handled or not allowed
2026-01-10 19:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:27:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60440201584-cloth-belt-341d-6w-x-48l-80-grit>: HTTP status code is not handled or not allowed
2026-01-10 19:27:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/westco-20l-lawn-and-garden-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:27:42 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/material-handling/ladders_personnel_lifts/step_ladders> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/material-handling/ladders_personnel_lifts/step_ladders landed on page that is not a product page.
2026-01-10 19:27:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/61500190436-cf-cloth-belt-337dc-2w-x-132l-a160-grit>: HTTP status code is not handled or not allowed
2026-01-10 19:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:27:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-30l-x-21w-x-69h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:27:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-42l-x-24w-x-69h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:27:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scag-sw-18khe-lawn-and-garden-replacement-battery-8ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:27:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylindrical-bearing-double-row-bore-75mm-0010-to-0020-radial-clearance-nn3015m2kc9nap4>: HTTP status code is not handled or not allowed
2026-01-10 19:27:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-ilsm36-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:27:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers>: HTTP status code is not handled or not allowed
2026-01-10 19:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:27:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-s1103-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:27:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lightalarms-ps10mp-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:27:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60070002385-461x-8-1-2w-x-11l-m15-grit>: HTTP status code is not handled or not allowed
2026-01-10 19:27:53 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers landed on page that is not a product page.
2026-01-10 19:27:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers>: HTTP status code is not handled or not allowed
2026-01-10 19:27:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers>: HTTP status code is not handled or not allowed
2026-01-10 19:27:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9682071-bench-grinder-wwheel-guards-dust-collection-ports-7-wheel-dia>: HTTP status code is not handled or not allowed
2026-01-10 19:27:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9682121-bench-grinder-wpedestal-floor-stand-12-wheel-dia-2hp-220v>: HTTP status code is not handled or not allowed
2026-01-10 19:27:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bisley-womens-short-sleeve-t-shirt-class-2-l-hi-vis-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/power_tools/power_grinder/die_grinders/corded_die_grinders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:27:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers>: HTTP status code is not handled or not allowed
2026-01-10 19:28:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bl1850-2-18v-lxt-lithium-ion-battery-50-ah-2pk>: HTTP status code is not handled or not allowed
2026-01-10 19:28:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/46-square-in-ground-mount-picnic-table-black>: HTTP status code is not handled or not allowed
2026-01-10 19:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/vehicle_flood_utility_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:28:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-mixer-0-11-quick-set-cmx1>: HTTP status code is not handled or not allowed
2026-01-10 19:28:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skate-wheel-conveyor-flexible-extendable-52-to-207l-x-28w-hdpe>: HTTP status code is not handled or not allowed
2026-01-10 19:28:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medium-duty-no-bump-dump-hopper-steel-1-cu-yd-4000-lb-capacity-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:28:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sure-lites-xr3-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:28:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sumostance-extension-ladder-w-hyperlite-cable-hooks-claw-v-bar-24-type-iaa>: HTTP status code is not handled or not allowed
2026-01-10 19:28:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 13917 pages (at 90 pages/min), scraped 5859 items (at 37 items/min)
2026-01-10 19:28:10 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/tools/power_tools/power_grinder/die_grinders/corded_die_grinders> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/tools/power_tools/power_grinder/die_grinders/corded_die_grinders landed on page that is not a product page.
2026-01-10 19:28:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ap-p-decorative-adaptor-plate-white-plastic-mounts>: HTTP status code is not handled or not allowed
2026-01-10 19:28:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4x1-2-dralon-woven-mini-roller-cover-12-pack-6-case-4ewv050-12>: HTTP status code is not handled or not allowed
2026-01-10 19:28:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/king-kombo-ladder-w-grip-n-go-release-hinge-5-type-iaa-4-step-375-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:28:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hyperlite-extension-ladder-w-cable-hooks-claw-v-bar-16-type-iaa-375-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:28:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/vehicle_flood_utility_lights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_lighting/vehicle_flood_utility_lights landed on page that is not a product page.
2026-01-10 19:28:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/439d-6aw-vibrating-fire-alarm-bell-6-20-24v-dc-85-amps-diode>: HTTP status code is not handled or not allowed
2026-01-10 19:28:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/johnlite-2920-emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:28:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optional-fork-pockets-ost-fp-modern-equipment-meco-open-mesh-steel-security-trucks>: HTTP status code is not handled or not allowed
2026-01-10 19:28:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mpsr1-shtw-ge-single-action-hex-screw-reset-weatherproof>: HTTP status code is not handled or not allowed
2026-01-10 19:28:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/revolution-20-articulated-extendable-ladder-w-ratchet-leveler-5-type-ia-300-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:28:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/overhaul-articulated-extendable-ladder-aluminum-4-type-iaa-375-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:28:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electrostatic-air-filter-merv-8-20w-x-1d-x-30h>: HTTP status code is not handled or not allowed
2026-01-10 19:28:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/project-tray-for-ladder-25-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:28:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hyperlite-extension-ladder-fiberglass-24-type-ia-300-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:28:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/battery-center-bc645-6v-5ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/full_height_storage_cabinets/stationary_storage_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:28:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rhino-sla1212-12v-12ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:28:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rhino-sla1012-12v-10ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:28:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-strip-curtain-roll-standard-grade-smooth-116-thickness-24w-x-60h-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelf_doors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:28:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reverse-bolt-on-hitch-bar-led-flood-light-for-2011-2016-ford-f250-f450-44a>: HTTP status code is not handled or not allowed
2026-01-10 19:28:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/urinal-mat-fresh-scent-black-w-velcro-z-mat>: HTTP status code is not handled or not allowed
2026-01-10 19:28:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/union-mx06040-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:28:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-12-528-emergency-light-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:28:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlake-bulk-storage-rack-upright-96-inch-h-x-48-inch-d-8-489-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:28:32 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/cabinets/full_height_storage_cabinets/stationary_storage_cabinets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/cabinets/full_height_storage_cabinets/stationary_storage_cabinets landed on page that is not a product page.
2026-01-10 19:28:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k1800-15-drawer-roller-cabinet-39-38w-x-18d-x-39h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:28:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hf-acid-eater-safety-spill-kit-5-gallons-2901-005>: HTTP status code is not handled or not allowed
2026-01-10 19:28:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k2000-7-drawer-roller-cabinet-29w-x-20d-x-34-1516h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:28:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/venter-burner-control-kit-for-oil-ck-63>: HTTP status code is not handled or not allowed
2026-01-10 19:28:35 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelf_doors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelf_doors landed on page that is not a product page.
2026-01-10 19:28:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panasonic-lcrb064p-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:28:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lithonia-xsh3g-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:28:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b6w72-dishwasher-water-supply-connector-72l>: HTTP status code is not handled or not allowed
2026-01-10 19:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/outdoor_furniture/umbrellas_awnings_shades/outdoor_umbrellas_bases/umbrellas already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:28:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-base-w-wheels-for-libra-cast-aluminum-100-lb-weight-bronze>: HTTP status code is not handled or not allowed
2026-01-10 19:28:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parasystems-ps640f-6v-45ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:28:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3114-button-head-socket-cap-screw-34l>: HTTP status code is not handled or not allowed
2026-01-10 19:28:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerm010l-l-fg-10-ner-food-grade-hoist-with-motorized-trolley-1-ton-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:28:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modern-equipment-meco-kl1-steel-tilt-hopper-truck-1-cu-yd-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:28:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amscope-3-5x-90x-trinocular-stereo-microscope-with-4-zone-144-led-ring-light>: HTTP status code is not handled or not allowed
2026-01-10 19:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/medical_supply_carts/medical_storage_carts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:28:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-dsm54-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:28:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kimwipe-holder-w-magnet-mount-small-white>: HTTP status code is not handled or not allowed
2026-01-10 19:28:50 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/outdoor_furniture/umbrellas_awnings_shades/outdoor_umbrellas_bases/umbrellas> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/outdoor_furniture/umbrellas_awnings_shades/outdoor_umbrellas_bases/umbrellas landed on page that is not a product page.
2026-01-10 19:28:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-jacket-collared-knit-cuff-light-blue-x-large>: HTTP status code is not handled or not allowed
2026-01-10 19:28:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-q102-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:28:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-full-length-lab-coat-snap-cuff-light-blue-small>: HTTP status code is not handled or not allowed
2026-01-10 19:28:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3087-double-tnut-112l>: HTTP status code is not handled or not allowed
2026-01-10 19:28:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-12m9-emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:28:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5625-stanchion-cross-clamp>: HTTP status code is not handled or not allowed
2026-01-10 19:28:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/puller-with-side-clamp-2-jaws-65-ton-capacity-3-78-opening-3-78-reach>: HTTP status code is not handled or not allowed
2026-01-10 19:28:58 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/medical_supply_carts/medical_storage_carts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/carts-trucks/special_purpose_carts_trucks/medical_supply_carts/medical_storage_carts landed on page that is not a product page.
2026-01-10 19:28:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-3-4-length-jacket-snap-cuff-maroon-2xl>: HTTP status code is not handled or not allowed
2026-01-10 19:29:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teledyne-1880005-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:29:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drive-pin-punch-set-steel-4l-116-516-punch-dia-redsilver>: HTTP status code is not handled or not allowed
2026-01-10 19:29:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3455-51618-x-34-shcs-and-slidein-economy-tnut>: HTTP status code is not handled or not allowed
2026-01-10 19:29:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4332-2-hole-inside-gusset-corner-bracket-15w>: HTTP status code is not handled or not allowed
2026-01-10 19:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/parking_traffic_signs/parking_traffic_signs_1 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:29:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jump-n-carry-jnc660-jump-starter-12v-18ah-jump-starter-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:29:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interstate-cytx14ah-bs-powersports-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:29:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/first-aid-kit-located-inside-sign-adhesive-dura-vinyl-3-12-x-5-whitegreen>: HTTP status code is not handled or not allowed
2026-01-10 19:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_signs_tags/parking_traffic_signs/parking_traffic_signs_1 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:29:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerp003s-15-ner-electric-hoist-push-trolley-14-ton-15-lift-36-ftmin-208v>: HTTP status code is not handled or not allowed
2026-01-10 19:29:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14008 pages (at 91 pages/min), scraped 5890 items (at 31 items/min)
2026-01-10 19:29:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerp003hd-10-ner-electric-hoist-push-trolley-14-ton-10-lift-539-ftmin-208v>: HTTP status code is not handled or not allowed
2026-01-10 19:29:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ambulance-station-traffic-safety-sign-egp-aluminum-12-x-24-whiteblue>: HTTP status code is not handled or not allowed
2026-01-10 19:29:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerp020cd-15-ner-electric-hoist-push-trolley-2-ton-15-lift-71-ftmin-230v>: HTTP status code is not handled or not allowed
2026-01-10 19:29:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2558-45-degree-support-18l>: HTTP status code is not handled or not allowed
2026-01-10 19:29:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/parking_traffic_signs/parking_traffic_signs_1> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/parking_traffic_signs/parking_traffic_signs_1 landed on page that is not a product page.
2026-01-10 19:29:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerp010sd-10-ner-electric-hoist-push-trolley-1-ton-10-lift-2845-ftmin-208v>: HTTP status code is not handled or not allowed
2026-01-10 19:29:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-contoured-full-zip-hooded-sweatshirt-class-3-m-hi-vis-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:29:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6515-single-flange-linear-bearing-brake-kit-ready>: HTTP status code is not handled or not allowed
2026-01-10 19:29:18 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_signs_tags/parking_traffic_signs/parking_traffic_signs_1> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_signs_tags/parking_traffic_signs/parking_traffic_signs_1 landed on page that is not a product page.
2026-01-10 19:29:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ner020l-10-ner-electric-hoist-hook-suspension-2-ton-10-lift-14-ftmin-230v>: HTTP status code is not handled or not allowed
2026-01-10 19:29:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tm-en530f-530cc-motorcycle-replacement-battery-2005-2010-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:29:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerm020l-l-fg-10-ner-food-grade-hoist-with-motorized-trolley-2-ton-capacity-230v>: HTTP status code is not handled or not allowed
2026-01-10 19:29:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contoured-reversible-puffer-vest-class-2-2xl-hi-vis-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/searchResult?q=7215bmuc3-angular-contact-ball-bearing-flush-ground-75mm-bore-x-130mm-od-x-25mm-w already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:29:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honda-ii-sp-50cc-motorcycle-replacement-battery-2002-2010-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:29:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/atk-406-cc-406cc-motorcycle-replacement-battery-1991-1996-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:29:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tm-smr530f-530cc-motorcycle-replacement-battery-2005-2011-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:29:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dolphin-scooter-ride-on-toys-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:29:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/think-green-label-w-recycle-sign-plastic-10-x-14>: HTTP status code is not handled or not allowed
2026-01-10 19:29:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qlink-all-150cc-scooter-and-moped-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:29:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glass-only-label-w-recycle-sign-adhesive-vinyl-10-x-14>: HTTP status code is not handled or not allowed
2026-01-10 19:29:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infinity-1-tier-1-door-ventilated-locker12-inch-wx18-inch-dx72-inch-h-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:29:32 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/searchResult?q=7215bmuc3-angular-contact-ball-bearing-flush-ground-75mm-bore-x-130mm-od-x-25mm-w> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/searchResult?q=7215bmuc3-angular-contact-ball-bearing-flush-ground-75mm-bore-x-130mm-od-x-25mm-w landed on page that is not a product page.
2026-01-10 19:29:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bruno-elite-mobility-scooter-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:29:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/linearorbital-shaker-fixing-clip-18900031-for-round-flasks-use-w-sk-o180-sk-o330>: HTTP status code is not handled or not allowed
2026-01-10 19:29:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bladez-ion-450-electric-scooter-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:29:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snugboot-wildlander-safety-knee-boots-size-9-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:29:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/07684-round-6-magnetic-parts-tray>: HTTP status code is not handled or not allowed
2026-01-10 19:29:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dispensmate-plus-bottletop-dispensers-73110002-45mm-thread-1-10ml>: HTTP status code is not handled or not allowed
2026-01-10 19:29:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mx-rd-e-analog-tube-rotator-100-220v-50-60hz>: HTTP status code is not handled or not allowed
2026-01-10 19:29:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/salorr-e-3900-electric-scooter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:29:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laser-print-paper-8-1-2-inch-x-11-inch-24-lb-3-hole-punched-white-500-sheets-ream>: HTTP status code is not handled or not allowed
2026-01-10 19:29:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/greeting-card-invitation-envelope-5-3-4-inch-x-8-3-4-inch-white-100-box>: HTTP status code is not handled or not allowed
2026-01-10 19:29:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-formula-500-deluxe-500cc-snowmobile-replacement-battery-1997-1998-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:29:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evidence-glue-top-scratch-pads-3-inch-x-5-inch-white-100-sheets-pad-12-pads-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:29:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/80w-wire-whip-for-m802-l800-l800d-80-qt-mixer>: HTTP status code is not handled or not allowed
2026-01-10 19:29:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-side-printable-business-card-2-inch-x-3-1-2-inch-white-1000-cards-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:29:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hook-tape-individual-strips-with-adhesive-75l-x-12w-black>: HTTP status code is not handled or not allowed
2026-01-10 19:29:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermal-register-cash-roll-3-inch-x-225-ft-white-24-rolls-carton>: HTTP status code is not handled or not allowed
2026-01-10 19:29:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/loop-tape-individual-dots-with-adhesive-12l-x-12w-white-pack-of-1440>: HTTP status code is not handled or not allowed
2026-01-10 19:29:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydrogen-peroxide-16-oz-bottle>: HTTP status code is not handled or not allowed
2026-01-10 19:29:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durapro-xcp-knee-boots-chevron-outsole-steel-toe-size-5-14h-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:29:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackable-shelf-bin-8-1-4w-x-12d-x-7h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:29:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fixed-height-steel-gantry-crane-6000-lb-capacity-15w-x-10-1516h>: HTTP status code is not handled or not allowed
2026-01-10 19:29:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackable-shelf-bin-6w-x-18d-x-7h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:30:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/production-workbench-chair-polyurethane-black>: HTTP status code is not handled or not allowed
2026-01-10 19:30:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-unit-36w-x-14d-x-74h-with-28-ssb443-stackable-shelf-bins-black>: HTTP status code is not handled or not allowed
2026-01-10 19:30:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-unit-36w-x-18d-x-74h-with-28-ssb463-stackable-shelf-bins-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:30:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inflatable-blower-1-speed-1-hp-br-252a>: HTTP status code is not handled or not allowed
2026-01-10 19:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/bins_totes_containers/protective_equipment_cases/waterproof_equipment_cases already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:30:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dispensing-bin-w-1-compartment-medium-12w-x-9d-x-7-1-4h>: HTTP status code is not handled or not allowed
2026-01-10 19:30:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-power-group-ub12260-d5747-sealed-lead-acid-replacement-battery-26ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:30:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emt-plastic-bushing-polyethylene-12size>: HTTP status code is not handled or not allowed
2026-01-10 19:30:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/904-1003-904-case-w-foam-102l-x-79w-x-45h-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:30:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/punch-tool-cup-1-34-size>: HTTP status code is not handled or not allowed
2026-01-10 19:30:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14104 pages (at 96 pages/min), scraped 5934 items (at 44 items/min)
2026-01-10 19:30:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21st-century-scientific-1248t-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:30:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-super-size-8-1-4w-x-23-7-8d-x-7h>: HTTP status code is not handled or not allowed
2026-01-10 19:30:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-mobility-600c-scooter-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:30:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insulated-no-thread-connector-3-12-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:30:15 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/bins_totes_containers/protective_equipment_cases/waterproof_equipment_cases> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/bins_totes_containers/protective_equipment_cases/waterproof_equipment_cases landed on page that is not a product page.
2026-01-10 19:30:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a7d1900b-pf-brown-aggregate-stainless-steel-pedestal-outdoor-drinking-fountain-w-pet-fountain>: HTTP status code is not handled or not allowed
2026-01-10 19:30:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-ft-type-1a-fiberglass-d-rung-straight-ladder-d6208-1>: HTTP status code is not handled or not allowed
2026-01-10 19:30:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-person-stage-24-inch-w-x-16-ft-l-2616>: HTTP status code is not handled or not allowed
2026-01-10 19:30:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/golden-technologies-alante-gp-201r-22nf-wheelchair-replacement-battery-55ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:30:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/19-inch-w-x-8-ft-l-plywood-decked-aluma-plank-5308-19>: HTTP status code is not handled or not allowed
2026-01-10 19:30:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conical-plastic-anchor-4-6-and-8-sizes-red-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:30:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chauffeur-mobility-viva-power-645-wheelchair-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:30:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ll-threaded-conduit-body-w-cover-and-gasket-1-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:30:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ev-rider-breeze-iv-cargo-edition-wheelchair-replacement-battery-75ah-12v-it>: HTTP status code is not handled or not allowed
2026-01-10 19:30:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insulated-no-thread-connector-1-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:30:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-profile-air-curtain-96-inch-w-door-480v-electric-3-ph-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:30:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ground-clamp-w-12-hub-bronze-2-12-4-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:30:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swireaw15120-replacement-emitter-for-15kw-120v-saw-xl-series-scombi-hos>: HTTP status code is not handled or not allowed
2026-01-10 19:30:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/golden-technologies-technology-alante-jr-gp-200-wheelchair-battery-22ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:30:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobcat-218es-zero-turn-radius-rider-lawn-and-garden-replacement-battery-18ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:30:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-toggle-anchor-kit-w-combo-pan-head-screw-8-size-tuff-pack-25-pieces>: HTTP status code is not handled or not allowed
2026-01-10 19:30:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-hook-low-carbon-steel-1-12-size-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:30:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2007-standard-class-3-two-tone-mesh-hook-loop-safety-vest-lime-2xl>: HTTP status code is not handled or not allowed
2026-01-10 19:30:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zipr-mobility-zipr3-3-wheel-leisure-travel-scooter-wheelchair-battery-12ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:30:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/walldriller-anchor-kit-w-combo-pan-head-screw-8-size-tuff-pack-50-pieces>: HTTP status code is not handled or not allowed
2026-01-10 19:30:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibration-mount-1-tapped-hole-1-threaded-stud-59-inch-dia-10mm-h-m4-x-7-thread>: HTTP status code is not handled or not allowed
2026-01-10 19:30:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-ply-pull-line-polypropylene-6500l-bluewhite-dispensing-pail>: HTTP status code is not handled or not allowed
2026-01-10 19:30:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hook-on-strap-carbon-steel-14-gauge-18-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:30:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leveling-foot-w-plastic-cap-3-8-16-x-393-inches-stud-236-inches-base-dia-445-inchesh-2250-lbs-cap-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:30:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conical-anchor-kit-w-combo-hex-head-screw-12-size-tuff-pack-101-pieces>: HTTP status code is not handled or not allowed
2026-01-10 19:30:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8002-class-3-waterproof-quiltlined-bomber-jacket-orangeblack-xl>: HTTP status code is not handled or not allowed
2026-01-10 19:30:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perf-16-w-3-step-steel-roll-ladder-10-d-top-stp-orange-318po>: HTTP status code is not handled or not allowed
2026-01-10 19:30:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perf-24-w-7-step-steel-roll-ladder-14-d-top-stp-hndrl-orange-fsh726po>: HTTP status code is not handled or not allowed
2026-01-10 19:30:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kawasaki-ksv700-a-b-kfx700-700cc-atv-replacement-battery-2004-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:30:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/trio-lighting-lightning-tl930219-emergency-light-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:30:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wallpro-400-orange-wall-mount-retracting-barrier-15-yellowblack-authorized-access-only-belt>: HTTP status code is not handled or not allowed
2026-01-10 19:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/wall_mount_belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:30:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/can-am-outlander-max-400-efi-xt-400cc-atv-replacement-battery-2011-2014-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:30:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2690gp-heavy-duty-steel-strap-cutter-for-straps-up-to-2-24l-2-x-05051-x-1-mm-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:30:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-gallon-screw-top-plastic-pail-lidwhite-987413>: HTTP status code is not handled or not allowed
2026-01-10 19:30:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ion-audio-block-rocker-am-fm-ipa16-speaker-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:30:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-cap-screw-grade-5-carbon-steel-12-13-x-1-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:30:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrf133501l56c-cast-iron-right-angle-worm-gear-reducer-501-ratio-56c-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:30:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peg-perego-thomas-track-rider-35168-ride-on-toys-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:30:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-head-wood-screw-phillips-brass-10-x-2-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:31:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/crowd_control/retractable_belt_barriers/wall_mount_belts>: HTTP status code is not handled or not allowed
2026-01-10 19:31:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrs262151r-cast-iron-right-angle-worm-gear-reducer-151-ratio>: HTTP status code is not handled or not allowed
2026-01-10 19:31:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-yfm700-grizzly-fi-4x4-auto-700cc-atv-replacement-battery-2007-2015-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:31:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hanging-style-photo-id-badge-holders-horizontal-3-x-4-100-box>: HTTP status code is not handled or not allowed
2026-01-10 19:31:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office-school-supply/basic_supplies/staplers_staples/staplers>: HTTP status code is not handled or not allowed
2026-01-10 19:31:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/employees-personnel-record-jacket-9-1-2-x-11-3-4-manila-100-jackets-box>: HTTP status code is not handled or not allowed
2026-01-10 19:31:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-low-rider-s-fxdls-1800cc-motorcycle-battery-2016-2017-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:31:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/can-am-spyder-st-se5-1000cc-motorcycle-replacement-battery-2013-2015-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 19:31:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14198 pages (at 94 pages/min), scraped 5976 items (at 42 items/min)
2026-01-10 19:31:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-heavy-duty-staples-1-4-leg-length-100-per-strip-5000-box>: HTTP status code is not handled or not allowed
2026-01-10 19:31:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jumbo-paper-clips-silver-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:31:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aprilia-rsv-mille-r-nera-1000cc-motorcycle-replacement-battery-2004-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:31:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fender-washer-low-carbon-steel-38-x-1-14-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:31:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laser-inkjet-name-badge-3-3-8-x-2-1-3-red-border-200-box>: HTTP status code is not handled or not allowed
2026-01-10 19:31:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrf325151l1824tc-cast-iron-right-angle-worm-gear-reducer-151-ratio-1824t-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:31:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-handling-cable-tie-8-size-red-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:31:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/label-unwinder-for-up-to-6-1-2w-x-12-dia-3-core-rolls>: HTTP status code is not handled or not allowed
2026-01-10 19:31:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-softail-slim-s-flss-1800cc-motorcycle-battery-2016-2017-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:31:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impulse-20-electric-stapler-20-sheet-210-staple-capacity-putty>: HTTP status code is not handled or not allowed
2026-01-10 19:31:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hurricane-industrial-concrete-remover-gallon-bottle-4-case-h1128cs>: HTTP status code is not handled or not allowed
2026-01-10 19:31:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-tap-bolt-silicon-bronze-38-16-x-1-14-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:31:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-ironhorse-ranger-1820cc-motorcycle-replacement-battery-2000-2002-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:31:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-add-on-cab97-2436-5x-36-inch-w-x-24-inch-d-x-97-inch-h-5-shelves-18-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:31:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-tap-bolt-low-carbon-steel-38-16-x-4-12-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:31:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simson-albartros-electric-start-50cc-motorcycle-replacement-battery-2001-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:31:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-heritage-softail-classic-flstc-1450cc-motorcycle-battery-1999-2006-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:31:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-fat-boy-flstf-1340cc-motorcycle-replacement-battery-1990-1998-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:31:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-lag-screw-carbon-steel-12-x-5-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:31:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-ironhorse-bandera-1640cc-motorcycle-replacement-battery-2008-2009-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:31:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-cvo-ultra-classic-electra-glide-flhtcuse5-1584cc-motorcycle-battery-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:31:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eco-funnel-ef-8-83b-8-with-83mm-cap-adapter-red-lid>: HTTP status code is not handled or not allowed
2026-01-10 19:31:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cineplex-popcorn-machine-4-oz-copper-popper-92-one-oz-servings-per-hour>: HTTP status code is not handled or not allowed
2026-01-10 19:31:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kawasaki-jt1200-stx-12f-1200cc-personal-watercraft-battery-2002-2007-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:31:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/windex-glass-surface-wet-wipes-28-wipes-pack-12-case-dvocb702325ct>: HTTP status code is not handled or not allowed
2026-01-10 19:31:38 [py.warnings] (PID: 62) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2026-01-10 19:31:39 [scrapy.extensions.feedexport] (PID: 62) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:6
2026-01-10 19:31:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simple-green-original-all-purpose-cleaner-lemon-24oz-btl-12cs-smp14002>: HTTP status code is not handled or not allowed
2026-01-10 19:31:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polaris-virage-700cc-personal-watercraft-replacement-battery-2000-2004-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:31:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/control-key-for-1585>: HTTP status code is not handled or not allowed
2026-01-10 19:31:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-ucf209-26-flange-mount-bearing-4-bolt-flange-set-screw-locking-bore-41-275-mm>: HTTP status code is not handled or not allowed
2026-01-10 19:31:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/208v-normally-closed-steam-actuator-without-end-switch-ag14d020>: HTTP status code is not handled or not allowed
2026-01-10 19:31:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-ucfl209-27-flange-mount-bearing-2-bolt-flange-set-screw-locking-bore-42-8625-mm>: HTTP status code is not handled or not allowed
2026-01-10 19:31:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-ucf206-18-flange-mount-bearing-4-bolt-flange-set-screw-locking-bore-28-575-mm>: HTTP status code is not handled or not allowed
2026-01-10 19:31:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xtreme-power-xa-750-xa750-electric-scooter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:31:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/terminator-terminator-ii-electric-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:31:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-22230exw33c3-150mm-bore-270mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:31:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-23938ew33-190mm-bore-260mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:31:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-23120ex1w33c3-100mm-bore-165mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:31:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pacesaver-eclipseatlas-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:31:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aquatec-all-other-models-mobility-scooter-replacement-battery-75ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:31:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-22340ew33c3-200mm-bore-420mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:31:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-row-cylindrical-roller-bearing-nu310myc3-50mm-bore-110mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:31:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adaptive-driving-systems-14-mobility-scooter-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:31:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dalton-epower-bariatric-heavy-duty-pc1422f-mobility-scooter-battery-55ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:32:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-row-cylindrical-roller-bearing-nj216m-80mm-bore-140mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:32:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pride-mobility-jet-3ultra-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:32:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/everest-jennings-everest-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:32:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/klip-it-open-add-on-oak73-1236-5-36-inch-w-x-12-inch-d-x-73-inch-h-5-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:32:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-in-t316-stainless-steel-full-port-ball-valve-3-piece-1000-psi>: HTTP status code is not handled or not allowed
2026-01-10 19:32:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-in-x-3-1-2-in-lead-free-seamless-red-brass-pipe-nipple-140-psi-sch-40-import>: HTTP status code is not handled or not allowed
2026-01-10 19:32:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-esd-wire-shelving-unit-starter-60w-x-12d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merits-pioneer-5-s534-s53431-mobility-scooter-replacement-battery-75ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:32:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-esd-wire-shelving-unit-starter-54w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14299 pages (at 101 pages/min), scraped 6025 items (at 49 items/min)
2026-01-10 19:32:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-bolt-closed-add-on-cat75-1236-8-36-inch-w-x-12-inch-d-x-75-inch-h-8-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:32:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/activecare-medical-spitfire-ex-1420-spitfire142016f-s12-mobility-scooter-battery-8ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:32:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-wire-shelving-unit-starter-48w-x-12d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/berm-builder-10-connecting-collar-8643>: HTTP status code is not handled or not allowed
2026-01-10 19:32:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-wire-shelving-unit-starter-48w-x-14d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pride-mobility-victory-10-lx-with-ctssuspension-mobility-scooter-battery-35ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:32:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-pad-for-m30-m40-m50-40150-40220-40310-40311-40312-black>: HTTP status code is not handled or not allowed
2026-01-10 19:32:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gw4x-guide-wheel-bearing-double-sealed-od-5994-mm-bore-15000-14992-mm-metric>: HTTP status code is not handled or not allowed
2026-01-10 19:32:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-wire-shelving-unit-add-on-36w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-mx-z-380-368cc-snowmobile-replacement-battery-2002-2006-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:32:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-wire-shelving-unit-add-on-60w-x-14d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-wire-shelving-unit-starter-36w-x-12d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-wire-shelving-unit-starter-60w-x-12d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-summit-800-xrs-159-800cc-snowmobile-replacement-battery-2007-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:32:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/things-to-do-today-pad-8-1-2-x-11-white-100-sheets-pad>: HTTP status code is not handled or not allowed
2026-01-10 19:32:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/literature-mailers-13-x-10-x-3-200lb-test-ect-32-white-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:32:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-wire-shelving-unit-starter-60w-x-36d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/145-round-contemporary-quartz-clock-plastic-case-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:32:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-gsx-800-ho-793cc-snowmobile-replacement-battery-2004-2005-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:32:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-literature-mailers-12-x-8-x-2-3-4-200lb-test-ect-32-white-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:32:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mk-5007k-7-14-circular-saw>: HTTP status code is not handled or not allowed
2026-01-10 19:32:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/line-voltage-thermostat-industrial-series-spst-cool-only-wire-leads-kto110>: HTTP status code is not handled or not allowed
2026-01-10 19:32:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-green-wire-shelving-unit-starter-36w-x-24d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arctic-cat-firecat-700-efi-sno-pro-international-698cc-snowmobile-battery-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:32:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-motor-for-30-evaporative-cooler-model-600543-292221>: HTTP status code is not handled or not allowed
2026-01-10 19:32:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-8713-containment-berm-rapid-rise-12-x-50-copolymer-2000>: HTTP status code is not handled or not allowed
2026-01-10 19:32:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-skandic-tundra-lt-600-600cc-snowmobile-replacement-battery-2010-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:32:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hollow-steel-vision-light-door-mortise-prep-hollow-hinge-18-ga-36w-x-84h>: HTTP status code is not handled or not allowed
2026-01-10 19:32:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plastic-locker-11-911212600-single-tier-12-x-12-x-60-1-wide-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:32:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plastic-locker-11-921218720-double-tier-12-x-18-x-36-1-wide-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:32:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plastic-locker-11-961212720-six-tier-12-x-12-x-12-1-wide-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 19:32:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plastic-locker-11-9z1212600-z-style-12-x-12-x-60-1-wide-burgundy>: HTTP status code is not handled or not allowed
2026-01-10 19:32:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/87-in-h-heavy-duty-patio-heater-cover-hvd-cvr-s-for-36-in-reflector-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:32:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/queuepro-300-retractable-belt-barrier-40-silver-post-16-blue-belt-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 19:32:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-rs90ltgt-rs-vector-lt-gt-900cc-snowmobile-replacement-battery-2009-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:32:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/-400-pro-segmented-asphalt-diamond-blade-14-dia-x-316t-x-1p-center-hole-dia>: HTTP status code is not handled or not allowed
2026-01-10 19:32:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermocouple-50001-k-bell-surface-probe-90-right-angle-shaft-type-k>: HTTP status code is not handled or not allowed
2026-01-10 19:32:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-grand-touring-1200-1200cc-snowmobile-replacement-battery-2010-2013-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:32:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-712-2-piece-full-port-316-ball-valve-stainless-steel-1-threaded>: HTTP status code is not handled or not allowed
2026-01-10 19:32:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-skandic-swt-ace-900-900cc-snowmobile-replacement-battery-2015-2018-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:32:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-rs90xt-rs-vector-xtx-900cc-snowmobile-replacement-battery-2016-2017-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:32:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-725-2-piece-large-port-ball-valve-carbon-steel-2-threaded>: HTTP status code is not handled or not allowed
2026-01-10 19:33:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ares-5-piece-outdoor-dining-set-31-1-2-w-x-29-h-table-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:33:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/764-vinyl-tape-2-x-36-yds-5-mil-green-6-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:33:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/766-striped-vinyl-tape-2-x-36-yds-5-mil-black-yellow-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:33:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/centrifugal-pump-motor-j064-15hp-208-230-460v-3600rpm-3ph-56j-fr-tefc>: HTTP status code is not handled or not allowed
2026-01-10 19:33:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-for-lil-luigi-and-le-peppe-1-2mm>: HTTP status code is not handled or not allowed
2026-01-10 19:33:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-response-basic-kit-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:33:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cpr-lifeshield-plus>: HTTP status code is not handled or not allowed
2026-01-10 19:33:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hg648-1-3hp-115-208-230v-1725rpm-1ph-tenv-48-fr>: HTTP status code is not handled or not allowed
2026-01-10 19:33:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-335di-g-butterfly-valve-with-epdm-seals--gear-operator-4-wafer>: HTTP status code is not handled or not allowed
2026-01-10 19:33:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14399 pages (at 100 pages/min), scraped 6074 items (at 49 items/min)
2026-01-10 19:33:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parks-medical-5al-doppler-medical-replacement-battery-1-3ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:33:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/explosion-proof-motor-u940-213ttgs1076-3hp-230-460v-1200rpm-3ph-epfc>: HTTP status code is not handled or not allowed
2026-01-10 19:33:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solar-jumper900-j900-jump-starter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:33:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clb6-6mm-board-camera-lens>: HTTP status code is not handled or not allowed
2026-01-10 19:33:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skytron-6500-elite-or-table-medical-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_alarms_signals/forklift_alert_sensors_systems already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:33:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u-channel-sign-post-10l-2-lbsft-galvanized-post-with-holes-top-to-bottom>: HTTP status code is not handled or not allowed
2026-01-10 19:33:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/113779a-round-dome-utility-fiber-optic-marker-white-pole-66h-42-above-ground-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:33:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cxf-series-screw-plug-immersion-heater-2npt-1500w-120v-20-58l>: HTTP status code is not handled or not allowed
2026-01-10 19:33:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c262-5kc42gn0014x-1-2hp-1725rpm-115-230v-1ph-56-fr-tefc>: HTTP status code is not handled or not allowed
2026-01-10 19:33:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nps-chemical-resistant-adjustable-height-science-table-plain-front-24-x-60-x-29-41-w-oak-legs>: HTTP status code is not handled or not allowed
2026-01-10 19:33:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/900-148-fish-tape-100-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:33:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hyperpure-pe-rt-tubing-1-12id-x-1-58od-x-100-coil-white>: HTTP status code is not handled or not allowed
2026-01-10 19:33:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-lp12-4-0l-sealed-lead-acid-replacement-battery-4-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:33:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rockford-rp-100-4-grease-interceptor-621-lbs-capacity-100-gpm-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:33:27 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_alarms_signals/forklift_alert_sensors_systems> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_alarms_signals/forklift_alert_sensors_systems landed on page that is not a product page.
2026-01-10 19:33:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rockford-rlsw-30-2-lint-separators-17-l-x-17-w-x-16-h-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:33:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-traffic-cone-mount-retracting-belt-barrier-30-caution-do-not-enter-belt>: HTTP status code is not handled or not allowed
2026-01-10 19:33:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amstron-ap-12180ev-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:33:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vestil-floor-lock-with-polyurethane-foot-pad-fl-lkl-3-3-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:33:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panasonic-lc-r12pf-sealed-lead-acid-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:33:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crackers-white-cheddar-3-oz-6box>: HTTP status code is not handled or not allowed
2026-01-10 19:33:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-union-mx-12120-12v-12ah-wheelchair-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:33:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gruber-power-gps-1250-sealed-lead-acid-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:33:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fruit-cups-mandarin-orange-7-oz-12carton>: HTTP status code is not handled or not allowed
2026-01-10 19:33:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gogreen-power-gg-27306-dryer-cord-6-4-wire-30-amp>: HTTP status code is not handled or not allowed
2026-01-10 19:33:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/palmgren-9680341-radial-arm-5-speed-bench-step-pulley-drill-press>: HTTP status code is not handled or not allowed
2026-01-10 19:33:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/palmgren-9634116-6-heavy-duty-rotary-table>: HTTP status code is not handled or not allowed
2026-01-10 19:33:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9009-18mm-solid-blade-pkg-qty-10>: HTTP status code is not handled or not allowed
2026-01-10 19:33:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-t-m-homecare-hs-360-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:33:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/helios-thermal-binding-machine-600-sheets-21-4-5-x-11-3-4-x-9-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:33:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelate-silver-epoxy-wire-shelving-unit-add-on-48w-x-30d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:33:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-55-gal-drum-2-door-self-close-flammable-cabinet-34w-x-34d-x-65h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:33:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-nexelate-silver-epoxy-wire-shelving-unit-add-on-72w-x-30d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:33:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fortress-scientific-760v-gp24-wheelchair-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:33:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50481-vertical-glove-box-and-kimwipe-holder-wmagnet-mount-6-x-4-x-31-white>: HTTP status code is not handled or not allowed
2026-01-10 19:33:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-nexelate-silver-epoxy-wire-shelving-unit-starter-36w-x-36d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:33:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/invacare-excel-fwd-capt-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:33:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-personnel-basket-crane-rigging-kit-rig-2>: HTTP status code is not handled or not allowed
2026-01-10 19:33:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelate-silver-epoxy-wire-shelving-unit-starter-36w-x-21d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:33:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fallte-7080sm-comforte1-d-full-body-harness-1-back-d-ring-size-sm-m>: HTTP status code is not handled or not allowed
2026-01-10 19:33:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelate-silver-epoxy-wire-shelving-unit-starter-42w-x-14d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:33:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelate-silver-epoxy-wire-shelving-unit-starter-60w-x-14d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:34:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-nexelate-silver-epoxy-wire-shelving-unit-starter-54w-x-14d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 19:34:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-ergo-wrist-strap-with-12-foot-coil-cord-and-alligator-clip-quarter-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:34:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/werner-3-type-1aa-fiberglass-podium-ladder-w-casters-375-lb-cap-pd7303-4c>: HTTP status code is not handled or not allowed
2026-01-10 19:34:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ev-rider-breeze-iii-gt-s-wheelchair-replacement-battery-75ah-12v-it>: HTTP status code is not handled or not allowed
2026-01-10 19:34:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magnetic-whiteboard-desk-divider-screen-with-universal-clamp>: HTTP status code is not handled or not allowed
2026-01-10 19:34:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelterlogic-95370-peak-style-shelter-14-x-ft-24-x-ft-12-ft-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/wire_shelving/poly_zbrite_wire_shelves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:34:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/horace-small-sent-uni-upgrad-secur-short-slv-shirt-white-ssxxl-sp46>: HTTP status code is not handled or not allowed
2026-01-10 19:34:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zipr-mobility-4-traveler-wheelchair-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:34:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14493 pages (at 94 pages/min), scraped 6118 items (at 44 items/min)
2026-01-10 19:34:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjusted-semilor-fr-1200-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:34:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/w-07012-1-1-4-in-wrot-copper-cap-copper>: HTTP status code is not handled or not allowed
2026-01-10 19:34:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-z-brite-wire-shelving-unit-add-on-60w-x-14d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:34:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-1-8-personal-rolling-paper-trimmer>: HTTP status code is not handled or not allowed
2026-01-10 19:34:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pride-mobility-jazzy-600-xl-wheelchair-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:34:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ryobi-mower-bmm2400-lawn-and-garden-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:34:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-poly-z-brite-wire-shelving-unit-starter-60w-x-14d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:34:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/shelving/wire_shelving/poly_zbrite_wire_shelves> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/shelving/wire_shelving/poly_zbrite_wire_shelves landed on page that is not a product page.
2026-01-10 19:34:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-vantage-comfort-grip-scissors>: HTTP status code is not handled or not allowed
2026-01-10 19:34:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acl-f-24x42-combination-louver-damper-with-flange-24wx42h>: HTTP status code is not handled or not allowed
2026-01-10 19:34:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/john-deere-gator-old-style-old-gator-lawn-and-garden-battery-12ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:34:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-hubless-fan-blade-9-inch-dia-31-pitch-cw-1-5-8-inch-blade-depth-5-blade>: HTTP status code is not handled or not allowed
2026-01-10 19:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:34:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-fixed-hub-fan-blade-9-inch-dia-26-pitch-ccw-5-16-inch-bore-1-1-4-inch-blade-depth-5-blade>: HTTP status code is not handled or not allowed
2026-01-10 19:34:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/astralite-eu-hd-180-emergency-light-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:34:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-numbers-adhesive-21-numbers-6-black>: HTTP status code is not handled or not allowed
2026-01-10 19:34:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lithonia-ind12250-emergency-light-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:34:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-cvt3gb3di-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:34:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-fixed-hub-fan-blade-8-inch-dia-24-pitch-cw-5-16-inch-bore-1-1-8-inch-blade-depth-5-blade>: HTTP status code is not handled or not allowed
2026-01-10 19:34:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mt-5210-lcr-meter>: HTTP status code is not handled or not allowed
2026-01-10 19:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/hand_tools_1/screwdrivers/multi_bit_screwdrivers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:34:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-slider-casement-window-a-c-10000-btu-115v-r32>: HTTP status code is not handled or not allowed
2026-01-10 19:34:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p-touch-tze-labeling-tape-07w-black-on-green>: HTTP status code is not handled or not allowed
2026-01-10 19:34:32 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/batteries_chargers/power_tool_batteries_chargers landed on page that is not a product page.
2026-01-10 19:34:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/die-cut-file-folder-labels-66-x-34-white-300-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:34:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p-touch-tze-labeling-tape-3-4w-black-on-white>: HTTP status code is not handled or not allowed
2026-01-10 19:34:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p-touch-tze-extra-strength-adhesive-labeling-tape-1w-black-on-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:34:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p-touch-tze-labeling-tape-1w-black-on-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:34:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermal-printer-labels-address-1-1-8-x-3-1-2-white-260-labels-box>: HTTP status code is not handled or not allowed
2026-01-10 19:34:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portalac-gs-pe4512r-emergency-light-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:34:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-high-cap-boltless-shelving-add-on-60-in-w-x-24-in-d-x-96-in-h-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:34:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/hand_tools_1/screwdrivers/multi_bit_screwdrivers>: HTTP status code is not handled or not allowed
2026-01-10 19:34:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-wide-boltless-shelving-add-on-60-in-w-x-36-in-d-x-96-in-h-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:34:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-flange-shelf-30-inch-l-x-36-inch-w-20-gauge-300-lb-capacity-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:34:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chloride-power-xs1rel-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:34:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u-design-rooftop-platforms-3-step-90-degree-incline-ladder-urtl903>: HTTP status code is not handled or not allowed
2026-01-10 19:34:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hl10000-series-double-hanging-pedestal-steel-desk-30-x-60-black-walnut>: HTTP status code is not handled or not allowed
2026-01-10 19:34:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elite-all-welded-combination-storage-cabinet-solid-door-36w-x-18d-x-72h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:34:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/johnlite-12-volt-7-5ah-emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/medical_chart_file_holders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:34:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-789539100-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:34:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transport-storage-cabinet-all-welded-36w-x-24d-x-72h-putty>: HTTP status code is not handled or not allowed
2026-01-10 19:34:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elite-bookcase-assembled-36w-x-12d-x-36h-dove-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:34:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shooters-cut-ballistic-shield-level-iii-31-12l-x-19-12w-black>: HTTP status code is not handled or not allowed
2026-01-10 19:34:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-a51216g5-emergency-light-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:34:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-a512-16-g5-emergency-light-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:34:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/four-shelf-extra-hd-boltless-shelving-add-on-36inw-x-24ind-x-60inh-wood-deck-usa>: HTTP status code is not handled or not allowed
2026-01-10 19:34:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regenerative-blower-ab-300-3-phase-1-stage-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 19:34:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ps-88-f-yellow-privacy-screen>: HTTP status code is not handled or not allowed
2026-01-10 19:34:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/medical_chart_file_holders> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/medical_chart_file_holders landed on page that is not a product page.
2026-01-10 19:35:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awsw-partition-88x7-f-black>: HTTP status code is not handled or not allowed
2026-01-10 19:35:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peg-perego-ranger-gt-ride-on-toys-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:35:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/five-shelf-extra-hd-boltless-shelving-add-on-36inw-x-12ind-x-60inh-laminate-deck-usa>: HTTP status code is not handled or not allowed
2026-01-10 19:35:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ps-88-f-latte-privacy-screen>: HTTP status code is not handled or not allowed
2026-01-10 19:35:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/four-shelf-heavy-duty-boltless-shelving-add-on-48inw-x-24ind-x-60inh-wood-deck-usa>: HTTP status code is not handled or not allowed
2026-01-10 19:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/partitions_dividers/acoustical_partition_panels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:35:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awrd-partition-70x84-f-charcoal-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:35:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smoking-shelter-s52fca-4sided-wleft-open-front-15l-x-5w-flat-roof-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:35:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smoking-shelter-52wsvrca-4sided-l-r-open-front-12l-x-5w-vented-standing-seam-roof-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:35:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zapworld-zappy-classic-electric-bicycle-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:35:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14590 pages (at 97 pages/min), scraped 6159 items (at 41 items/min)
2026-01-10 19:35:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awsw-partition-80x7-p-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/partitions_dividers/acoustical_partition_panels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:35:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-shelf-high-cap-boltless-shelving-steel-deck-starter-72-in-w-x-24-in-d-x-60-in-h>: HTTP status code is not handled or not allowed
2026-01-10 19:35:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mongoose-al1020-bike-electric-bicycle-replacement-battery-14ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:35:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-traxter-650-4x4-auto-cvt-650cc-atv-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:35:15 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/partitions_dividers/acoustical_partition_panels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/partitions_dividers/acoustical_partition_panels landed on page that is not a product page.
2026-01-10 19:35:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd24-3-three-24-skates-wing-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:35:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/log-rack-ls932-96-8-foot-32mm>: HTTP status code is not handled or not allowed
2026-01-10 19:35:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f50-face-shield-window-polycarb-iruv-30-8l-x-15-12w-116-thick-green>: HTTP status code is not handled or not allowed
2026-01-10 19:35:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m20-metric-eyebolt-shoulder-pattern-m20-x-250>: HTTP status code is not handled or not allowed
2026-01-10 19:35:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-nano-lok-twin-leg-hot-work-self-retracting-lifeline-web--aluminum-rebar-hook-6l>: HTTP status code is not handled or not allowed
2026-01-10 19:35:22 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office/partitions_dividers/acoustical_partition_panels> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office/partitions_dividers/acoustical_partition_panels landed on page that is not a product page.
2026-01-10 19:35:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pam-esd-anti-fatigue--anti-static-insole-mens-1415>: HTTP status code is not handled or not allowed
2026-01-10 19:35:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/megasole-anti-fatigue-insole-mens-1213>: HTTP status code is not handled or not allowed
2026-01-10 19:35:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/megasole-anti-fatigue-insole-mens-1415>: HTTP status code is not handled or not allowed
2026-01-10 19:35:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aprilia-tuono-50-50cc-motorcycle-replacement-battery-2004-2005-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:35:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-in-pvc-1-piece-ball-valve-sche-40-150-psi-socket>: HTTP status code is not handled or not allowed
2026-01-10 19:35:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ribbon-corrfilm-type-2pk>: HTTP status code is not handled or not allowed
2026-01-10 19:35:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/we-wvhs30-18-286tp-12-vhs-motor-30hp-1800rpm-286tp-230-460v-wpi>: HTTP status code is not handled or not allowed
2026-01-10 19:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/definite_purpose_electric_motors/vertical_hollow_shaft_motors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:35:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/right-response-bleeding-control-kit-1-24-persons-15-pieces-fabric-case>: HTTP status code is not handled or not allowed
2026-01-10 19:35:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-vx-cruiser-vx1100am-deluxe-1052cc-watercraft-battery-2009-2014-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:35:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd-welded-workbench-60-x-36-adj-height-louvered-panel-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 19:35:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/289910000-graduated-pitcher-polypropylene-1000ml>: HTTP status code is not handled or not allowed
2026-01-10 19:35:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd-welded-workbench-60-x-30-adj-height-pegboard-panel-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 19:35:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-welded-workbench-48-x-24-adj-height-lower-shelf-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 19:35:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/369400000-sterileware-sampling-spoon-polystyrene-1-4-teaspoon-200-box-white>: HTTP status code is not handled or not allowed
2026-01-10 19:35:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/369020010-sterileware-scoops-polystyrene-2oz-10-box-white>: HTTP status code is not handled or not allowed
2026-01-10 19:35:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-cabinet-deep-door-with-176-blue-bins-16-ga-all-welded-cabinet-48-w-x-24-d-x-72-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:35:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bsm-inc-ada-ss-sink-4-station-with-electronic-faucet-wall-mount-144l-x-20w-x-6d-sink>: HTTP status code is not handled or not allowed
2026-01-10 19:35:40 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/definite_purpose_electric_motors/vertical_hollow_shaft_motors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/definite_purpose_electric_motors/vertical_hollow_shaft_motors landed on page that is not a product page.
2026-01-10 19:35:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-cabinet-flush-door-with-171-yellow-bins-16-ga-all-welded-cabinet-48-w-x-24-d-x-78-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:35:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gssafe-1701-class-2-heavy-duty-safety-vest-lime-l>: HTTP status code is not handled or not allowed
2026-01-10 19:35:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/voyager-gt-overboots-with-heels-cleated-outsole-4xl-12h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:35:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-welded-workbench-48-x-30-adj-height-open-base-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 19:35:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lance-cali-classic-150-150cc-scooter-and-moped-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:35:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/summit-ct663bbi-built-in-undercounter-refrigerator-freezer-51-cu-ft-24-wide>: HTTP status code is not handled or not allowed
2026-01-10 19:35:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-heavy-duty-workbench-60w-x-24d-x-36h-3600-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:35:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permobil-chairman-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:35:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/navigator-5153-gt-insulated-overboots-cleated-outsole-xs-15h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:35:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zapworld-zappy-3pro-electric-scooter-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 19:35:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-welded-workbench-60-x-24-lower-shelf--1-drawer-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 19:35:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-stp-stl-all-direct-safet-roll-lad-wt-actu-24-expan-stp-wa-ad-073214x>: HTTP status code is not handled or not allowed
2026-01-10 19:35:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zap-3-pro-flex-48v-electric-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:35:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drive-medical-hawk-mobility-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:35:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-cl1385cc64-4-1-2dia-x-64h-grey-w-no-tape>: HTTP status code is not handled or not allowed
2026-01-10 19:35:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelate-72w-x-30d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:36:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rear-replacement-blade-red-gum-3-18x316x36-716-13-holes-vf-81216>: HTTP status code is not handled or not allowed
2026-01-10 19:36:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locker-leg-stand-for-24-lockers-1p18645-go-gray-24-x-16-1-4-x-5>: HTTP status code is not handled or not allowed
2026-01-10 19:36:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maxi-soil-locker-llmcsd-go-gray-24-5-16-x-21-1-4-x-84-1-2>: HTTP status code is not handled or not allowed
2026-01-10 19:36:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/folded-garment-lcker-ll10cco-gosv-10-compart-combo-lock-16-1-2-x-16-1-4-x-77-1-2-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:36:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z1321-34x16-pb-automatic-draining-wall-hydrant-exposed-ecolotrol-anti-siphon-34-x-16>: HTTP status code is not handled or not allowed
2026-01-10 19:36:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z1315-34x8-non-freeze-wall-hydrant-wbronze-casing-exposed-34-x-8>: HTTP status code is not handled or not allowed
2026-01-10 19:36:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelate-36w-x-30d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-oal-straight-steel-roller-conveyor-19-roller-dia-10-bf-45-axle-center>: HTTP status code is not handled or not allowed
2026-01-10 19:36:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optiway-technology-lx-mobility-scooter-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 19:36:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bladez-xtr-street-450-electric-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 19:36:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14687 pages (at 97 pages/min), scraped 6201 items (at 42 items/min)
2026-01-10 19:36:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-oal-straight-steel-roller-conveyor-19-roller-dia-10-bf-3-axle-center>: HTTP status code is not handled or not allowed
2026-01-10 19:36:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pride-mobility-ultra-x-sc40x--sc44x-mobility-scooter-battery-14ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 19:36:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelate-60w-x-21d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2hdsa30l-cantilever-rack-straight-arm-withlip-30-long>: HTTP status code is not handled or not allowed
2026-01-10 19:36:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xdu1266-cantilever-rack-double-sided-upright-66d-x-12h>: HTTP status code is not handled or not allowed
2026-01-10 19:36:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/du16106-ns-cantilever-rack-double-sided-upright-106w-x-16h>: HTTP status code is not handled or not allowed
2026-01-10 19:36:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-power-panel-tray-41l-x-14w-x-7d>: HTTP status code is not handled or not allowed
2026-01-10 19:36:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spiral-hanging-coil>: HTTP status code is not handled or not allowed
2026-01-10 19:36:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-mx-z-800-800cc-snowmobile-replacement-battery-2004-2013-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:36:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-formula-iii-700-700cc-snowmobile-replacement-battery-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 19:36:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-54w-x-21d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:36:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-48w-x-21d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:36:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-display-hook-2>: HTTP status code is not handled or not allowed
2026-01-10 19:36:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-renegade-backcountry-800r-800cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:36:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-60w-x-36d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:36:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-hinged-snap-ring-34>: HTTP status code is not handled or not allowed
2026-01-10 19:36:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-54w-x-14d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:36:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelate-24w-x-18d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-heavy-duty-cleaner-degreaser-gallon-bottle4-bottlescase-640406>: HTTP status code is not handled or not allowed
2026-01-10 19:36:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-30w-x-14d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-mx-z-550f-550cc-snowmobile-replacement-battery-2003-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 19:36:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-42w-x-18d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/material-handling/ladders_personnel_lifts/step_stands_stools already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:36:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-54w-x-18d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-2-sided-pegboard-lean-tool-rack-36w-x-24d>: HTTP status code is not handled or not allowed
2026-01-10 19:36:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-3l340-v-belt-3-8-x-34>: HTTP status code is not handled or not allowed
2026-01-10 19:36:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-54w-x-21d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:36:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-30w-x-21d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wood-adjustable-literature-organizer-36-compartment>: HTTP status code is not handled or not allowed
2026-01-10 19:36:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-a45-4l470-v-belt-1-2-x-47>: HTTP status code is not handled or not allowed
2026-01-10 19:36:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-b37-5l400-v-belt-5-8-x-40>: HTTP status code is not handled or not allowed
2026-01-10 19:36:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/material-handling/ladders_personnel_lifts/step_stands_stools>: HTTP status code is not handled or not allowed
2026-01-10 19:36:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8283bk-lightweight-performance-hi-vis-t-shirt-class-2-black-bottom-m-lime>: HTTP status code is not handled or not allowed
2026-01-10 19:36:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelite-48w-x-24d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:36:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelite-36w-x-24d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2000-arborist-kit-ht107-150-scfm>: HTTP status code is not handled or not allowed
2026-01-10 19:36:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-b61-5l640-v-belt-5-8-x-64>: HTTP status code is not handled or not allowed
2026-01-10 19:36:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz-8993-hard-hat-red-safety-light-magnetic-beacon-light-black>: HTTP status code is not handled or not allowed
2026-01-10 19:36:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machine-vac-replacement-gasket-mv2000g>: HTTP status code is not handled or not allowed
2026-01-10 19:36:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/advance-transformer-electronic-ballast-icf2s13h1ldk-120-277v-13-watts-B842440RS>: HTTP status code is not handled or not allowed
2026-01-10 19:36:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-24w-x-14d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:36:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supply-126-2ft-mixed-lamp-recycling-box>: HTTP status code is not handled or not allowed
2026-01-10 19:36:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pump-motor-vhecp4106t-3-phase-20-hp-230-460-volts-3540-rpm-60-hz-tefc-256hp>: HTTP status code is not handled or not allowed
2026-01-10 19:36:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-72w-x-24d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/locks_lockout_devices/lockout_tagout_devices/lockout_padlocks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:36:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pump-motor-jl1205a-1-phase-033-hp-115-230-volts-3450-rpm-60-hz-open-56j>: HTTP status code is not handled or not allowed
2026-01-10 19:36:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelite-48w-x-18d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:36:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelite-60w-x-18d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:37:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-12-outlet-power-strip-9-ft-cord-14-3-lighted-switch-15a-1875-watts-etl>: HTTP status code is not handled or not allowed
2026-01-10 19:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_microscopes/stereo_microscopes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:37:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-48w-x-14d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:37:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-vecp2333t-3-ph-15-hp-230-460-v-1765-rpm-tefc-254tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:37:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-motor-230-460-v-20-hp-1765-rpm-3-ph-256t-opsb>: HTTP status code is not handled or not allowed
2026-01-10 19:37:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/intrinsically-safe-rechargeable-led-scene-light-1000-lumen-high-green>: HTTP status code is not handled or not allowed
2026-01-10 19:37:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s19224t-halo-eyeface-wash-stainless-steel-bowl-3-gpm>: HTTP status code is not handled or not allowed
2026-01-10 19:37:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s45-2453-service-kit-eyeface-wash-black-48-gpm>: HTTP status code is not handled or not allowed
2026-01-10 19:37:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelite-36w-x-21d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:37:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-phase-motor-em3661t-5-1755-hp-3-rpm-182t-frame-foot-mount-tefc-575-volts>: HTTP status code is not handled or not allowed
2026-01-10 19:37:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triangular-umbrella-stand-black>: HTTP status code is not handled or not allowed
2026-01-10 19:37:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ken-forging-tb105-e-e-turnbuckle-assembly-eye-eye-1-2-13-x-13-1-8-carbon>: HTTP status code is not handled or not allowed
2026-01-10 19:37:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14785 pages (at 98 pages/min), scraped 6241 items (at 40 items/min)
2026-01-10 19:37:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ken-forging-tb110-e-e-hdg-turnbuckle-assembly-eye-eye-1-8-x-19-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 19:37:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/laboratory_microscopes/stereo_microscopes>: HTTP status code is not handled or not allowed
2026-01-10 19:37:10 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/locks_lockout_devices/lockout_tagout_devices/lockout_padlocks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/locks_lockout_devices/lockout_tagout_devices/lockout_padlocks landed on page that is not a product page.
2026-01-10 19:37:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-motor-230-460-v-50-hp-1775-rpm-3-ph-326tc-opsb>: HTTP status code is not handled or not allowed
2026-01-10 19:37:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-72w-x-14d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:37:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brake-motor-ebm3218t-3-phase-208-230-460-volts-5-hp-1750-rpm-open-184t-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:37:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-poly-green-42wx24dx69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:37:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolution-deluxe-6151-cap-style-hard-hat-hdpe-shell-6-pt-polyester-suspension-ratchet-adj-green>: HTTP status code is not handled or not allowed
2026-01-10 19:37:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kilimanjaro-type-ii-full-brim-hard-hat-hdpe-shell-4-pt-textile-suspension-ratchet-adjustment-org>: HTTP status code is not handled or not allowed
2026-01-10 19:37:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k284-front-max-atv-tire-8010-2fm-i-22x800-10-2ply>: HTTP status code is not handled or not allowed
2026-01-10 19:37:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolution-deluxe-6161-full-brim-hard-hat-hdpe-shell-6-pt-suspension-ratchet-adjustment-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:37:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/light-duty-steel-wheel-875-r-8x175-2-1-2-centered-hub-1-2bb-rib-tread>: HTTP status code is not handled or not allowed
2026-01-10 19:37:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-ecp84110t-4-3-ph-40-hp-460-v-1770-rpm-tefc-324t-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:37:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-poly-green-42wx24dx60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:37:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/benchmixer-xlq-quechers-shaker-vortexer-with-quechers-racks>: HTTP status code is not handled or not allowed
2026-01-10 19:37:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1002412-00u0019-gondola-shelving-24w-x-12d-almond>: HTTP status code is not handled or not allowed
2026-01-10 19:37:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelon-30w-x-14d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:37:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-ecp63665t-4-3-ph-5-hp-460-v-1750-rpm-tefc-184t-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:37:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-storage-box-push-button-767-c-with-wall-mount-14-x-6>: HTTP status code is not handled or not allowed
2026-01-10 19:37:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-em3546t-5g-3-ph-1-hp-575-v-1800-rpm-tefc-143t-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:37:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-em3611t-g-3-ph-3-hp-208-230-460-v-1760-rpm-tefc-182t-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:37:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3a-ssmach-rod-end-machined-304-stainless-3-8-16-x-3-1-2>: HTTP status code is not handled or not allowed
2026-01-10 19:37:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-42w-x-21d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:37:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-poly-green-36wx18dx60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:37:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-round-black-cafeteria-table-with-8-stools-oak-mdf-core-top-black-stools>: HTTP status code is not handled or not allowed
2026-01-10 19:37:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-concrete-cart-w-8-inch-high-performance-elastomer-casters-10-5-cu-ft-capacity-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:37:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pistol-safe-wmc-6-331208h-ws25-6-tier-12-x-8-x-23-12-pistol-cap-hasp-lock-stealth>: HTTP status code is not handled or not allowed
2026-01-10 19:37:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-54wx14dx80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:37:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-step-steel-roll-ladd-rear-exit-gate-24-30-plat-perf-rwsr108246-xr>: HTTP status code is not handled or not allowed
2026-01-10 19:37:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-step-steel-roll-ladd-rear-exit-gate-24-30-plat-serr-rwsr114242-xr>: HTTP status code is not handled or not allowed
2026-01-10 19:37:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-poly-green-54w-x-18d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:37:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permanent-magnet-motor-cspm3558t-3-ph-230-460-v-2-hp-1800-rpm-tefc-145tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:37:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/threshold-ramp-th1232-12l-x-32w-600-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:37:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-telescoping-electric-high-lift-pallet-truck-3000-lbs-21-forks-987672>: HTTP status code is not handled or not allowed
2026-01-10 19:37:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dt-dx024rd-life-ring-w-tape-uscg-tc-orange-24>: HTTP status code is not handled or not allowed
2026-01-10 19:37:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultratech-gloves-latex-cut-a4-impact-1-abrasion-4-puncture-5-gray-blue-2xl>: HTTP status code is not handled or not allowed
2026-01-10 19:37:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-54wx18dx69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:37:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-sided-mobile-maintenance-cart-st-2448-6py-pb-pegboard-panel-3600-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:37:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelon-60w-x-14d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:37:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/encoder-tachometer-mounting-kits-w-o-tach-417709-17-tefc-frames-c180>: HTTP status code is not handled or not allowed
2026-01-10 19:37:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ed-266-can-opener-electric-stainless-steel-1-speed-table-top-115v>: HTTP status code is not handled or not allowed
2026-01-10 19:37:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tach-generator-encoder-based-digital-py-flange-mount-ptg1024ld-dpy-1024ppr>: HTTP status code is not handled or not allowed
2026-01-10 19:37:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-ac-motor-c-face-kit-field-conversion-35-8764-odp-35-56c-143-5tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:37:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-acting-hollow-hole-hydraulic-cylinder-12-ton-1-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:37:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-72w-x-24d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:38:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-ac-motor-c-face-kit-field-conversion-39-1403-odp-39-284-6uc-tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:38:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2517-x-1-11-16-1-11-16-x-24-2517-series-tapered-locking-steel-bushing-1-11-16-bore>: HTTP status code is not handled or not allowed
2026-01-10 19:38:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-ac-motor-c-face-kit-field-conversion-10-1305-tefc-10-284-6uc-tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/task_lighting/magnifier_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:38:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electra-led-floor-lamp-satin-black>: HTTP status code is not handled or not allowed
2026-01-10 19:38:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonichek-pocket-size-sound-level-meter-40-to-130db>: HTTP status code is not handled or not allowed
2026-01-10 19:38:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-48w-x-18d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 19:38:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alarm-clock-black>: HTTP status code is not handled or not allowed
2026-01-10 19:38:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14883 pages (at 98 pages/min), scraped 6288 items (at 47 items/min)
2026-01-10 19:38:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/windlass-tensioner-premium-steel-34-1-14-strap-width-028-to-035-strap-gauge>: HTTP status code is not handled or not allowed
2026-01-10 19:38:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-strapping-dispenser-w-break-arm-core-inner-depth-16>: HTTP status code is not handled or not allowed
2026-01-10 19:38:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/specialty-cutter-hook-knife-built-in-storage-chamber-in-handle-36-per-box>: HTTP status code is not handled or not allowed
2026-01-10 19:38:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bp5158-cooks-fork-with-curved-tines>: HTTP status code is not handled or not allowed
2026-01-10 19:38:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/task_lighting/magnifier_lights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/task_lighting/magnifier_lights landed on page that is not a product page.
2026-01-10 19:38:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4688m-hamburger-turner-6-x-5-wood>: HTTP status code is not handled or not allowed
2026-01-10 19:38:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bolted-teardrop-pallet-rack-starter-48inw-x-48ind-x-120inh-6590-lbs-shelf-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:38:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90061-n20-chargers-25-count>: HTTP status code is not handled or not allowed
2026-01-10 19:38:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/celltreat-scientific-products-10l-pipette-mla-dtipper-pink>: HTTP status code is not handled or not allowed
2026-01-10 19:38:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyester-cord-strapping-34w-x-1650l-x-0045-thick-4-x-6-core-white>: HTTP status code is not handled or not allowed
2026-01-10 19:38:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beverage-napkins-1-ply-9-1-2-x-9-1-2-4000-carton-white>: HTTP status code is not handled or not allowed
2026-01-10 19:38:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-hazelnut-creme-coffee-regular-arabica-bean-25-oz-18-carton>: HTTP status code is not handled or not allowed
2026-01-10 19:38:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-plates-10-1-8-diameter-microwavable-heavy-weight-125-pack-white-pathways-design>: HTTP status code is not handled or not allowed
2026-01-10 19:38:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r036c-6-air-sander-with-hook--loop-516-orbit-dia-13000-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:38:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jurni-flip-top-training-table-with-casters-60l-x-24w-x-29h-asian-night>: HTTP status code is not handled or not allowed
2026-01-10 19:38:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rocacrylic-3800-acrylic-enamel-paint-1-gallon-can-gloss-black>: HTTP status code is not handled or not allowed
2026-01-10 19:38:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-diamond-plate-metallic-pvc-flooring-beige-2-5mm-x-4-x-25>: HTTP status code is not handled or not allowed
2026-01-10 19:38:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/squids-3386-arm-band-idbadge-holder-one-size-red>: HTTP status code is not handled or not allowed
2026-01-10 19:38:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ps-usb-portable-shipping-scale-150-lb-capacity-x-0-02-lb-readability-legal-for-trade>: HTTP status code is not handled or not allowed
2026-01-10 19:38:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/controls-merz-z151-1-aa-change-over-switch-w-zero-pos-1-pole-20a-4-hole-front-mount>: HTTP status code is not handled or not allowed
2026-01-10 19:38:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-2000-handhole-gasket-312-x-5-x-916-graphite-obround-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:38:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coolsize-10000-btu-compact-portable-air-conditioner-arc-101cw>: HTTP status code is not handled or not allowed
2026-01-10 19:38:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-180-handhole-gasket-212-x-334-x-12-black-rubber-obround-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:38:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16001p-16-000-watts-pto-generator-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/floor_mats/entrance_mats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:38:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mm110w-one-gang-16-in-1-weatherproof-white>: HTTP status code is not handled or not allowed
2026-01-10 19:38:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dxs2153-8-extended-anvil-attachment-12-drive>: HTTP status code is not handled or not allowed
2026-01-10 19:38:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cl-ultra-speed-20-battery-burnisher-56383525>: HTTP status code is not handled or not allowed
2026-01-10 19:38:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plug-h5229x6-3-8-inch-tube-od>: HTTP status code is not handled or not allowed
2026-01-10 19:38:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tx4000-esd-cleanroom-apparel-soft-sole-boot-cover-2xl-white>: HTTP status code is not handled or not allowed
2026-01-10 19:38:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mechanix-wear-taa-original174-covert-gloves-synthetic-leather-wtrekdry153-large>: HTTP status code is not handled or not allowed
2026-01-10 19:38:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/soft-scrub-brush-for-bdso-2728-scrubber-14w-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 19:38:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combination-nipple-hcn075-3-4-inch-75-npt-male-thread-75-inch-hose-id-3125-inchl>: HTTP status code is not handled or not allowed
2026-01-10 19:38:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combination-nipple-hcn150-1-1-2-inch-150-npt-male-thread-150-inch-hose-id-4000-inchl>: HTTP status code is not handled or not allowed
2026-01-10 19:38:47 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/floor_mats/entrance_mats> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/floor_mats/entrance_mats landed on page that is not a product page.
2026-01-10 19:38:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clearance-metro-corrosionresistant-shelving-components-60x24-shelf-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:38:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m153-quiet-space-headphones-bluetooth-black>: HTTP status code is not handled or not allowed
2026-01-10 19:38:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/achim-tivoli-ii-self-adhesive-vinyl-floor-planks-6-x-36-redwood-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:38:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/achim-sterling-self-adhesive-vinyl-floor-tile-12-x-12-light-oak-plank-45-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:38:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-series-clamp-for-pipe-sscp038-3-8-inch-id>: HTTP status code is not handled or not allowed
2026-01-10 19:38:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3wtbk-11116-tapered-bushing-kit-1-1116-fits-reducer-styles-smr3wsmr3>: HTTP status code is not handled or not allowed
2026-01-10 19:38:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ediusa-ballistic-tshirt-tested-to-level-iiia-ballistic-resistance-xxxlarge-black>: HTTP status code is not handled or not allowed
2026-01-10 19:38:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stamped-welding-flange-fa100-1-inch-aluminum-2360-inch-od-0134-inch-thick>: HTTP status code is not handled or not allowed
2026-01-10 19:38:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fr-cotton-apron-w-black-anodized-snap-dark-brown-l>: HTTP status code is not handled or not allowed
2026-01-10 19:38:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wing-type-quick-detach-hydraulic-coupler-qddc201-1-1-4-inch-npt-coupler-dust-cap-w-chain>: HTTP status code is not handled or not allowed
2026-01-10 19:38:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reducer-h5015x16x12-1-inch-to-3-4-inch-tube-reduction>: HTTP status code is not handled or not allowed
2026-01-10 19:38:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sa-whiffle-typical-14-double-48-electric-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:39:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sa-mirella-free-standing-credenza-bbb-bf-whiteash>: HTTP status code is not handled or not allowed
2026-01-10 19:39:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lbw-portable-gas-heater-tradesman-170-ultra-170k-btu-lpg-w-diagnostics>: HTTP status code is not handled or not allowed
2026-01-10 19:39:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worldwide-electric-winl77-5-1-213-5tc-helical-inline-speed-reducer-213-5tc-input-flange-5-1-ratio>: HTTP status code is not handled or not allowed
2026-01-10 19:39:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pneumatic-air-valve-bav015-1-4-inch-5-port-3-position-detented-4-way-air-valve>: HTTP status code is not handled or not allowed
2026-01-10 19:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worldwide-electric-winl87-80-1-145tc-helical-inline-speed-reducer-145tc-input-flange-80-1-ratio>: HTTP status code is not handled or not allowed
2026-01-10 19:39:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ds-703b-heat-shrink-tape-3w-x-180l-9mil-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clark-foam-products-1001269-foam-sheet-35280-poly-natural-1x24x72>: HTTP status code is not handled or not allowed
2026-01-10 19:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/building-materials/foam/foam_sheets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wind-pro-full-zip-hooded-sweater-reflective-flame-resistant-3xl-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:39:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 14980 pages (at 97 pages/min), scraped 6331 items (at 43 items/min)
2026-01-10 19:39:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snap-button-down-long-sleeve-work-shirt-5xl-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:39:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3346300-63h-mobile-post>: HTTP status code is not handled or not allowed
2026-01-10 19:39:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wind-pro-full-zip-hooded-sweater-reflective-flame-resistant-2xl-tall-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snap-button-down-long-sleeve-work-shirt-l-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:39:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts landed on page that is not a product page.
2026-01-10 19:39:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-visibility-athletic-performance-t-shirt-flame-resistant-6-oz-s-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-visibility-athletic-performance-t-shirt-flame-resistant-6-oz-xl-tall-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:39:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts landed on page that is not a product page.
2026-01-10 19:39:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-visibility-athletic-performance-t-shirt-flame-resistant-6-25-oz-s-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:39:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-locker-accessory-individual-slope-top-15w-x-18d-x-6h-729-parchment>: HTTP status code is not handled or not allowed
2026-01-10 19:39:18 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/building-materials/foam/foam_sheets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/building-materials/foam/foam_sheets landed on page that is not a product page.
2026-01-10 19:39:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-locker-accessory-individual-slope-top-18w-x-24d-x-8h-729-parchment>: HTTP status code is not handled or not allowed
2026-01-10 19:39:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grd-vf-circulator-pump-ups-40-80-2-96402763-230v-3455-rpm-cast-iron>: HTTP status code is not handled or not allowed
2026-01-10 19:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-purp-truck-chest-alum-full-size-13-1-cu-ft-cap-664-0-01>: HTTP status code is not handled or not allowed
2026-01-10 19:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/truck_boxes_utility_boxes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/coats_jackets/cold_weather_jackets_coats>: HTTP status code is not handled or not allowed
2026-01-10 19:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/truck_boxes_utility_boxes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/underbed-truck-bx-black-steel-compact-2-3-cu-ft-525-5-02>: HTTP status code is not handled or not allowed
2026-01-10 19:39:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/shirts>: HTTP status code is not handled or not allowed
2026-01-10 19:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-30w-x-36l-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-32w-x-36l-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insulated-quilted-sweatshirt-lime-15176-comfort-rating-5xl-0488rhvl5xl>: HTTP status code is not handled or not allowed
2026-01-10 19:39:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-36w-x-36l-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:39:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vented-plastic-shelving-36x21x74-nexelon-finish-331488N>: HTTP status code is not handled or not allowed
2026-01-10 19:39:31 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:39:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/truck_boxes_utility_boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:39:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/vehicle-fleet-maintenance/towing_cargo_management/truck_boxes_utility_boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-30w-x-28l-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:39:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:39:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:39:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5653700-sase-shlvg-48x24x86-add-on>: HTTP status code is not handled or not allowed
2026-01-10 19:39:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-32w-x-33l-black>: HTTP status code is not handled or not allowed
2026-01-10 19:39:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-32w-x-30l-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:39:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dewalt-dw235g-12-vsr-drill-0-850-rpm-534210>: HTTP status code is not handled or not allowed
2026-01-10 19:39:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5444300-4wire-shelf-truck>: HTTP status code is not handled or not allowed
2026-01-10 19:39:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-42w-x-36l-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:39:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5652000-sase-shlvg-48x24x63-starter>: HTTP status code is not handled or not allowed
2026-01-10 19:39:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:39:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-29w-x-29l-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:39:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-28w-x-31l-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:39:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bayview-outdoor-solar-lamp>: HTTP status code is not handled or not allowed
2026-01-10 19:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cardboard-single-wall-corrugated-box-13-x-13-x-17-200lb-test-ect-32-kraft-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:39:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cardboard-single-wall-corrugated-box-17-x-11-x-8-200lb-test-ect-32-kraft-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:39:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/friedrich-packaged-terminal-air-conditioner7700-btu-cool-292278>: HTTP status code is not handled or not allowed
2026-01-10 19:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-inch-drive-hex-bit-impact-socket-6-mm>: HTTP status code is not handled or not allowed
2026-01-10 19:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:39:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-42w-x-29l-green>: HTTP status code is not handled or not allowed
2026-01-10 19:39:55 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:39:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/copper-compression-lug-standard-barrel-2-hole-with-inspection-window-2-0-awg-3-8-stud-black>: HTTP status code is not handled or not allowed
2026-01-10 19:39:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-48w-x-34l-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:39:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j3016-oh-needle-bearing-drawn-cup-caged-oil-hole-bore-47625mm>: HTTP status code is not handled or not allowed
2026-01-10 19:39:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j45-oh-needle-bearing-drawn-cup-caged-oil-hole-bore-635mm>: HTTP status code is not handled or not allowed
2026-01-10 19:39:59 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:39:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtt67-needle-bearing-drawn-cup-caged-2-seals-bore-9525mm>: HTTP status code is not handled or not allowed
2026-01-10 19:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-34w-x-33l-white>: HTTP status code is not handled or not allowed
2026-01-10 19:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-32w-x-31l-green>: HTTP status code is not handled or not allowed
2026-01-10 19:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hk1416-2rs-needle-bearing-drawn-cup-caged-metric-2-seals-bore-13995mm>: HTTP status code is not handled or not allowed
2026-01-10 19:40:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vem31116-1hp-1800rpm-56c-frame-3ph-208-230-460v-odp-c-face-footless-premium-efficiency>: HTTP status code is not handled or not allowed
2026-01-10 19:40:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bordette-decorative-border-2-1-4-inch-x-50-foot-royal-blue-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:40:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15060 pages (at 80 pages/min), scraped 6351 items (at 20 items/min)
2026-01-10 19:40:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/artista-ii-washable-tempera-paint-nontoxic-16-oz-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:40:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multiplication-0-12-pocket-flash-cards-3-1-8-inch-x-5-1-4-inch-56-cards-box>: HTTP status code is not handled or not allowed
2026-01-10 19:40:10 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:40:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:40:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:40:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kleenex-ultra-soft-hand-towels-pop-up-box-white-70box-18-boxescarton-kcc-11268>: HTTP status code is not handled or not allowed
2026-01-10 19:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pocket-cargo-pants-heavy-duty-twill-30w-x-30l-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/office_computer_desks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elkay-ezstl8wsvrlk-ezh20-bi-level-water-bottle-filling-station-8-gph-light-gray-vr-bubbler>: HTTP status code is not handled or not allowed
2026-01-10 19:40:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bench-water-caddy-bc-25ag-25-gal>: HTTP status code is not handled or not allowed
2026-01-10 19:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-12-gauge-cabinet-with-128-hook-on-bins-36w-x-24d-x-78h>: HTTP status code is not handled or not allowed
2026-01-10 19:40:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-58w-x-30l-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:40:22 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:40:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/relaxed-fit-jeans-42w-x-34l-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pickup-truck-bed-caddy-63-gallons>: HTTP status code is not handled or not allowed
2026-01-10 19:40:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:40:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:40:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/desks_workstations/office_computer_desks>: HTTP status code is not handled or not allowed
2026-01-10 19:40:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-ghs2052alv2-toxic-ghs-label-vinyl-2-x-2-250-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:40:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:40:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/69000-series-rectangular-desk-shell-llr69903-48-w-x-30-d-x-29-1-2-cherry>: HTTP status code is not handled or not allowed
2026-01-10 19:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pl-16470-window-screen-plunger-latch-aluminum-5-32-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:40:33 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:40:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-kingportable-reel-rack-24-28-dia-coilsprecuation-blue-798017>: HTTP status code is not handled or not allowed
2026-01-10 19:40:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-steel-deck-machine-dolly-10000-lb-capacity-987815>: HTTP status code is not handled or not allowed
2026-01-10 19:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/dollies/machine_skates_dollies already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-westex-35w-x-36l-black>: HTTP status code is not handled or not allowed
2026-01-10 19:40:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r75i-tas-135-2303-rotary-screw-air-compressor-3-phase-230-volts-10hp-120-gal>: HTTP status code is not handled or not allowed
2026-01-10 19:40:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-double-tier-locker-2-wide-12w-x-12d-x-36h-assembled-black>: HTTP status code is not handled or not allowed
2026-01-10 19:40:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pocket-cargo-pants-heavy-duty-twill-42w-x-32l-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:40:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pocket-cargo-pants-heavy-duty-twill-50w-x-34l-dark-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:40:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-work-coveralls-44-regular-red>: HTTP status code is not handled or not allowed
2026-01-10 19:40:41 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:40:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nesting-wire-baskets-18x24x8-chrome-nesting-price-each-for-qty-3>: HTTP status code is not handled or not allowed
2026-01-10 19:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nesting-wire-baskets-price-each-for-qty-3>: HTTP status code is not handled or not allowed
2026-01-10 19:40:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/carts-trucks/dollies/machine_skates_dollies>: HTTP status code is not handled or not allowed
2026-01-10 19:40:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/automotive-black-rtv-silicone-12270-103-oz-cartridge>: HTTP status code is not handled or not allowed
2026-01-10 19:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_repair_maintenance/fuel_exhaust_systems/tank_repair_sealant already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-jeans-basket-weave-flame-resistant-8-oz-31w-x-unhemmed-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:40:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3l290k-v-belt-kevlar-3-8-x-29>: HTTP status code is not handled or not allowed
2026-01-10 19:40:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-jeans-basket-weave-flame-resistant-8-oz-36w-x-32l-green>: HTTP status code is not handled or not allowed
2026-01-10 19:40:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-door-magnetic-weatherstrip-01636-brown-36-inch-x-81-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:40:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-profile-door-jamb-weatherstrip-kit-87635-white-36-inch-x-84-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:40:53 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:40:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-density-foam-tape-open-cell-02113-gray-1-2-inch-x-3-4-inch-x-17-foot>: HTTP status code is not handled or not allowed
2026-01-10 19:40:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/en-9-hd-drop-forged-eye-nut-7-8-9-style-b-c1030>: HTTP status code is not handled or not allowed
2026-01-10 19:40:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/decorative-aluminum-divider-with-nails-69138-72-inchl-for-1-16-inch-thickness-anodized>: HTTP status code is not handled or not allowed
2026-01-10 19:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_repair_maintenance/fuel_exhaust_systems already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:40:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-sheet-small-holes-84160-36-inch-x-36-inch-x-020-inch-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:40:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wallbase-dry-back-75960-120-footl-x-2-1-2-inchw-almond>: HTTP status code is not handled or not allowed
2026-01-10 19:40:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-work-pants-reflective-material-flame-resistant-34w-x-unhemmed-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:41:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-jeans-basket-weave-flame-resistant-8-oz-34w-x-32l-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:41:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pl4082-plus-barrier-set-15-yellow-caution-banner>: HTTP status code is not handled or not allowed
2026-01-10 19:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:41:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shredder-bags-25-x-23-x-45-50-box-fits-crusher-1049s-450-p44>: HTTP status code is not handled or not allowed
2026-01-10 19:41:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shredder-oil-16oz-pint-bottles-12-case>: HTTP status code is not handled or not allowed
2026-01-10 19:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:41:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cargo-pants-with-double-reinforced-knees-flame-resistant-42w-x-32l-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:41:05 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_repair_maintenance/fuel_exhaust_systems> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/vehicle-fleet-maintenance/vehicle_repair_maintenance/fuel_exhaust_systems landed on page that is not a product page.
2026-01-10 19:41:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cargo-pants-with-double-reinforced-knees-flame-resistant-38w-x-unhemmed-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:41:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelving-add-on-72-inch-w-x-14-inch-d-x-63-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 19:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:41:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cargo-pants-with-double-reinforced-knees-flame-resistant-30w-x-28l-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:41:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-30w-x-14d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 19:41:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15146 pages (at 86 pages/min), scraped 6378 items (at 27 items/min)
2026-01-10 19:41:10 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:41:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-24w-x-14d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 19:41:11 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:41:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/x-o-rust-12-oz-aerosol-can-safety-colors-paint-primer-in-one-bright-red-flat-125844>: HTTP status code is not handled or not allowed
2026-01-10 19:41:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-54w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:41:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/woodsman-100-acrylic-natural-deck-siding-fence-wood-stain-cedartone-gallon-149320>: HTTP status code is not handled or not allowed
2026-01-10 19:41:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls landed on page that is not a product page.
2026-01-10 19:41:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-60w-x-18d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 19:41:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-36w-x-18d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 19:41:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:41:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/protective_clothing_workwear/pants_shorts_overalls>: HTTP status code is not handled or not allowed
2026-01-10 19:41:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-9a-1ph-remote-start-reset-button-100-250v-3-1-4-2a>: HTTP status code is not handled or not allowed
2026-01-10 19:41:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manitowoc-ice-rns-12a-ice-maker-water-disp-countertop-nugget-style-air-cooled-self-contained>: HTTP status code is not handled or not allowed
2026-01-10 19:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/office_machines/calculators/display_calculators already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:41:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drivable-power-stocker-li-18-blue-ps-12d>: HTTP status code is not handled or not allowed
2026-01-10 19:41:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nestable-plastic-shelf-bin-8-3-8w-x-11-5-8d-x-8h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:41:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-12a-3ph-remote-start-terminals-reset-button-250-500v-7-6-10a>: HTTP status code is not handled or not allowed
2026-01-10 19:41:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eco-premier-carpet-tile-22157314000-geometric-18l-x-18w-x-14h-grey-ash-12pk>: HTTP status code is not handled or not allowed
2026-01-10 19:41:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cab-command-center-13-in-w-9012-3-01>: HTTP status code is not handled or not allowed
2026-01-10 19:41:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-12a-1ph-remote-start-terminals-start-stop-100-250v-4-2-5-7a>: HTTP status code is not handled or not allowed
2026-01-10 19:41:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-174-plastic-box-truck-12-bushel-yellow-272517-5-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:41:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-mech-van-pack-mid-roof-ford-trans-148-wb-600-8213l>: HTTP status code is not handled or not allowed
2026-01-10 19:41:31 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/office_machines/calculators/display_calculators> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/office_machines/calculators/display_calculators landed on page that is not a product page.
2026-01-10 19:41:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/installation-clip-hfic96-carboninfused-nylon-96pk>: HTTP status code is not handled or not allowed
2026-01-10 19:41:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-16a-3ph-remote-start-start-stop-250-500v-16-20a>: HTTP status code is not handled or not allowed
2026-01-10 19:41:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-square-table-ladder-back-bar-ht-set-graphite-nebula-laminate-table-black-vinyl-chair>: HTTP status code is not handled or not allowed
2026-01-10 19:41:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-16a-3ph-direct-online-reset-button-250-500v-13-16a>: HTTP status code is not handled or not allowed
2026-01-10 19:41:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deep-groove-ball-bearings-inch-1621-2rs-sealed-light-duty-05-inch-bore-1375-inch-od>: HTTP status code is not handled or not allowed
2026-01-10 19:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/floor_mats/esd_mats already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:41:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r24blhda-basket-truck>: HTTP status code is not handled or not allowed
2026-01-10 19:41:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/my2030-34bl-3-shelf-cart-black>: HTTP status code is not handled or not allowed
2026-01-10 19:41:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-angular-contact-bearings-5302-2rs-2-rubber-seals-heavy-duty-15mm-bore-42mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:41:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/457010-hex-cap-screw-1-4-20-x-1-carbon-steel-zinc-grade-5-ft-unc-usa-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:41:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-angular-contact-bearings-5207-zz-2-metal-shields-medium-duty-35mm-bore-72mm-od>: HTTP status code is not handled or not allowed
2026-01-10 19:41:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-26a-1ph-start-stop-24-60v-13-16a>: HTTP status code is not handled or not allowed
2026-01-10 19:41:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/011037-socket-cap-screw-4-40-x-1-2-steel-black-oxide-ft-unc-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:41:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/101273-socket-set-screw-10-32-x-1-4-cup-point-steel-black-oxide-fine-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:41:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/floor_mats/esd_mats>: HTTP status code is not handled or not allowed
2026-01-10 19:41:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/858200-external-tooth-lock-nut-1-4-28-steel-zinc-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:41:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/323360-finished-hex-nut-1-8-low-carbon-steel-hot-dip-galvanized-unc-pkg-of-25>: HTTP status code is not handled or not allowed
2026-01-10 19:41:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/329410-hex-jam-nut-3-8-24-low-carbon-steel-unf-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:41:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-38a-1ph-remote-start-start-stop-100-250v-35-40a>: HTTP status code is not handled or not allowed
2026-01-10 19:41:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d80rb-osha-sign-danger-no-smoking-in-this-area-10-x-14-whiteredblack>: HTTP status code is not handled or not allowed
2026-01-10 19:41:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dcl136-nfpa-label-symbol-alk-7-12-x-7-12-whiteblack-5pk>: HTTP status code is not handled or not allowed
2026-01-10 19:41:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d38rb-osha-sign-danger-flammable-liquids-10-x-14-whiteredblack>: HTTP status code is not handled or not allowed
2026-01-10 19:41:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-52a-3ph-separate-coil-voltage-start-stop-100-250v-25-33a>: HTTP status code is not handled or not allowed
2026-01-10 19:41:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v18c-extension-spring-096-od-x-01205-wire-dia-x-6-oal-1423-lbs-in-mbhd>: HTTP status code is not handled or not allowed
2026-01-10 19:42:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e1c-extension-spring-0187-od-x-0023-wire-dia-x-125-oal-244-lbs-in-mbhd>: HTTP status code is not handled or not allowed
2026-01-10 19:42:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d98rb-osha-sign-danger-oxygen-10-x-14-whiteredblack>: HTTP status code is not handled or not allowed
2026-01-10 19:42:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c49rb-osha-sign-caution-no-smoking-10-x-14-yellowblack>: HTTP status code is not handled or not allowed
2026-01-10 19:42:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-compression-spring-042-od-x-0055-x-15-music-wire-pkg-of-5>: HTTP status code is not handled or not allowed
2026-01-10 19:42:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-65a-3ph-separate-coil-voltage-start-stop-100-250v-50-60a>: HTTP status code is not handled or not allowed
2026-01-10 19:42:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n1r-osha-sign-notice-heading-only-7-x-10-whiteblueblack>: HTTP status code is not handled or not allowed
2026-01-10 19:42:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-65a-3ph-separate-coil-voltage-reset-button-100-250v-44-53a>: HTTP status code is not handled or not allowed
2026-01-10 19:42:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-structural-column-protector-6-1-4-square-opening-yellow-cp1214>: HTTP status code is not handled or not allowed
2026-01-10 19:42:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15240 pages (at 94 pages/min), scraped 6419 items (at 41 items/min)
2026-01-10 19:42:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nema-4x-enclosed-motor-starter-65a-1ph-direct-online-reset-button-100-250v-57-67a>: HTTP status code is not handled or not allowed
2026-01-10 19:42:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c167p-osha-sign-caution-keep-electrical-panel-area-clear-10-x-7-yellowblack>: HTTP status code is not handled or not allowed
2026-01-10 19:42:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rpt1g-tags-danger-do-not-operate-6-x-3-whiteredblack-25pk>: HTTP status code is not handled or not allowed
2026-01-10 19:42:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vsm-abrasive-belt-103674-zirconia-alumina-2-x-36-80-grit>: HTTP status code is not handled or not allowed
2026-01-10 19:42:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mixed-greens-with-spathyfillum-decorative-vase-silk-plant>: HTTP status code is not handled or not allowed
2026-01-10 19:42:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20in-olive-wreath>: HTTP status code is not handled or not allowed
2026-01-10 19:42:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dieffenbachia-with-wood-vase-silk-plant-set-of-2-variegated>: HTTP status code is not handled or not allowed
2026-01-10 19:42:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simplehuman-174-slim-toilet-brush-white-bt1083>: HTTP status code is not handled or not allowed
2026-01-10 19:42:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vsm-abrasive-belt-286981-ceramic-2-1-2-x-48-80-grit>: HTTP status code is not handled or not allowed
2026-01-10 19:42:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vsm-abrasive-belt-307348-ceramic-4-x-24-36-grit>: HTTP status code is not handled or not allowed
2026-01-10 19:42:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tec-clean-a1-electronics-and-pcb-ultrasonic-cleaner-solution-10-8-ph-10-l>: HTTP status code is not handled or not allowed
2026-01-10 19:42:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k-flex-for-right-ear-small>: HTTP status code is not handled or not allowed
2026-01-10 19:42:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ac-1-1-2-inch-npt-coalescing-filter-430-cfm-8-000-hr-0-01-micron-232-psi>: HTTP status code is not handled or not allowed
2026-01-10 19:42:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/star-single-wire-surveillance-earpiece-motorola-blackbox-hyt-relm-tekk-radios>: HTTP status code is not handled or not allowed
2026-01-10 19:42:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ac-inpass-1-2-inch-npt-2-in-1-coalescing-filter-16-cfm-8-000-hr-0-01-micron-232-psi>: HTTP status code is not handled or not allowed
2026-01-10 19:42:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-polypropylene-tagging-fasteners-803-standard-black-3l-5000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:42:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/victorian-style-keyed-mortise-glass-knob-lock-set-classic-bronze-finish>: HTTP status code is not handled or not allowed
2026-01-10 19:42:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/53-osha-stairway-stair36o-6-53>: HTTP status code is not handled or not allowed
2026-01-10 19:42:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/55-104-fatmax-wrecking-bar-36-inch-long>: HTTP status code is not handled or not allowed
2026-01-10 19:42:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-454-fractional-tape-rule-1-inch-x-25>: HTTP status code is not handled or not allowed
2026-01-10 19:42:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-rack-guard-double-end-black>: HTTP status code is not handled or not allowed
2026-01-10 19:42:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/43-511-shock-resistant-magnetic-torpedo-level-9-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:42:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tra709t-heavy-duty-narrow-crown-staples-9-16-inch-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:42:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylinder-storage-cabinet-single-door-horizontal-4-cylinder-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:42:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-54-inch-w-x-24-inch-d-x-50-inch-h-2000-lbs-cap-5-open-grid-shelves-dunnage-stand>: HTTP status code is not handled or not allowed
2026-01-10 19:42:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keyless-rigid-coupling-c600e175-steel-175d-x-378d-134l-shaft>: HTTP status code is not handled or not allowed
2026-01-10 19:42:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/keyless-rigid-coupling-c600e337-steel-3375d-x-6693d-338l-shaft>: HTTP status code is not handled or not allowed
2026-01-10 19:42:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-42-inch-w-x-21-inch-d-x-86-inch-h-2000-lbs-cap-5-open-grid-shelves>: HTTP status code is not handled or not allowed
2026-01-10 19:42:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-keyless-drill-chuck-5133-13-j2-jacobs-2-132-12-tir-0015-7-051-335>: HTTP status code is not handled or not allowed
2026-01-10 19:42:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-476-4-in-plastic-blastgate-for-50-765-dust-collector>: HTTP status code is not handled or not allowed
2026-01-10 19:42:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-42-inch-w-x-24-inch-d-x-74-inch-h-2000-lbs-cap-5-open-grid-shelves>: HTTP status code is not handled or not allowed
2026-01-10 19:42:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-sided-self-supporting-tank-hs-1600-128-dia-x-44h-1600-gallon-cap-green>: HTTP status code is not handled or not allowed
2026-01-10 19:42:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-shaft-arbor-al6-lefthand-type-b-11316l-thread-fits-34-shaft>: HTTP status code is not handled or not allowed
2026-01-10 19:42:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/28mm-locking-assembly-c405-series-c405m28x55-metric-m6-x-35>: HTTP status code is not handled or not allowed
2026-01-10 19:42:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-shaft-arbor-a3fs-righthand-type-c-212l-thread-fits-38-shaft>: HTTP status code is not handled or not allowed
2026-01-10 19:42:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-60-inch-w-x-21-inch-d-1000-lbs-cap-removable-solid-shelf-mat-polymer-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:42:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-60-inch-w-x-24-inch-d-x-62-inch-h-2000-lbs-cap-4-solid-shelves-dunnage-stand>: HTTP status code is not handled or not allowed
2026-01-10 19:42:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-frame-pvc-decontamination-pool-stfdp-48-48l-x-12w-x-65h-230-gallon-cap-black>: HTTP status code is not handled or not allowed
2026-01-10 19:42:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-air-wall-decontamination-pool-aadp-33-36l-x-12w-x-29h-60-gallon-cap-red>: HTTP status code is not handled or not allowed
2026-01-10 19:42:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sws-plus-030-micro-precision-wire-strippers-03mm-solid-stranded-wires>: HTTP status code is not handled or not allowed
2026-01-10 19:42:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-cartridge-quadro-wire-tool>: HTTP status code is not handled or not allowed
2026-01-10 19:42:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-tapping-screw-10-x-1-12-flange-hex-head-pkg-of-140-itw-teks174-21332>: HTTP status code is not handled or not allowed
2026-01-10 19:42:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cb101002-head-flushing-with-hose-and-nozzle-30-x-30>: HTTP status code is not handled or not allowed
2026-01-10 19:43:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eyesaver-service-sink-faucet-with-thermostatic-mixing-valve-sef-9000-tw-chrome-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:43:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-caster-kit-for-jobox-cabinets>: HTTP status code is not handled or not allowed
2026-01-10 19:43:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quick-adjust-wire-shelving-36-x-24-x-86-poly-z-brite>: HTTP status code is not handled or not allowed
2026-01-10 19:43:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-unit-54-inch-w-x-21-inch-d-x-74-inch-h-2000-lbs-cap-5-solid-shelves-dunnage-stand>: HTTP status code is not handled or not allowed
2026-01-10 19:43:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kni-cobra-water-pump-plier-w-polished-head-plastic-coated-handle-16-inch-l>: HTTP status code is not handled or not allowed
2026-01-10 19:43:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/burglary-file-safe-cabinet-2-hr-factory-fire-rating-combo-lock-22w-x-22d-x-40h>: HTTP status code is not handled or not allowed
2026-01-10 19:43:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x48x79-metromax-cart>: HTTP status code is not handled or not allowed
2026-01-10 19:43:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x48x68-metro-q-cart>: HTTP status code is not handled or not allowed
2026-01-10 19:43:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-inch-air-circulator-fan-3-speed-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:43:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15340 pages (at 100 pages/min), scraped 6467 items (at 48 items/min)
2026-01-10 19:43:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-basket-truck-with-vinyl-liner-18-bushel-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:43:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medina-48-1-2w-non-handed-return-48-1-2w-x-20d-x-29-1-2h-mocha>: HTTP status code is not handled or not allowed
2026-01-10 19:43:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/florence-4b-horizontal-mailbox-140064pla-33-38-h-6-parcel-front-loading-aluminum-usps>: HTTP status code is not handled or not allowed
2026-01-10 19:43:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24x60x68-metromax-cart>: HTTP status code is not handled or not allowed
2026-01-10 19:43:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drift-punch-set-96a-7-piece-set>: HTTP status code is not handled or not allowed
2026-01-10 19:43:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21x16x1-1-2-shelf>: HTTP status code is not handled or not allowed
2026-01-10 19:43:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dressing-retention-sheet-4w-x-11-yards-5-pcs>: HTTP status code is not handled or not allowed
2026-01-10 19:43:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-grade-square-recess-power-bit-13054-number2-tip-1-15-16-long>: HTTP status code is not handled or not allowed
2026-01-10 19:43:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/abdominal-binder-medium-fits-30-x-36-waist-12h-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:43:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mega-straight-shelf-mobile-single-48w-x-15d-x-42h-birch-plywood>: HTTP status code is not handled or not allowed
2026-01-10 19:43:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/25-tub-mobile-cubbie-w-clear-tubs-60w-x-15d-x-35-1-2h-birch-plywood>: HTTP status code is not handled or not allowed
2026-01-10 19:43:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tms331h-traffic-sign-reserved-parking-ohio-18-x-12-white>: HTTP status code is not handled or not allowed
2026-01-10 19:43:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-tray13-1-2l-x-11w-x-3h-almond>: HTTP status code is not handled or not allowed
2026-01-10 19:43:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-crook-handle-cane-w-vinyl-grip-6-pairs>: HTTP status code is not handled or not allowed
2026-01-10 19:43:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tm0166h-traffic-sign-no-parking-graphic-symbol-18-x-12-white>: HTTP status code is not handled or not allowed
2026-01-10 19:43:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shower-stool-single-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:43:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nmc-tm501k-traffic-sign-advance-turn-arrow-right-15-x-21-white>: HTTP status code is not handled or not allowed
2026-01-10 19:43:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/work-height-platform-truck-w-hardboard-top-24-x-60>: HTTP status code is not handled or not allowed
2026-01-10 19:43:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/work-height-platform-truck-24x48-mold-on-rubber-wheels-lip-edge>: HTTP status code is not handled or not allowed
2026-01-10 19:43:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dynago-quad-6-rollator-black>: HTTP status code is not handled or not allowed
2026-01-10 19:43:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indirect-fired-forced-air-heater-hs2000id-205000-btu>: HTTP status code is not handled or not allowed
2026-01-10 19:43:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-l552-10-in-type-2-5hp-left-tilt-w-52-in-fence-system>: HTTP status code is not handled or not allowed
2026-01-10 19:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/medical_laboratory_cold_storage/laboratory_cold_storage/laboratory_freezers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:43:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-flammable-material-storage-refrigerator-abt-fr-3004-30-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:43:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rt207448-3-aluminum-retractable-shelving-48w-x-20d-x-73h>: HTTP status code is not handled or not allowed
2026-01-10 19:43:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beveled-welding-mat-black-7-8in-x-3ft-x-75ft-full-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:43:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anatomical-model-functional-elbow-joint>: HTTP status code is not handled or not allowed
2026-01-10 19:43:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amscope-stereo-zoom-microscope-on-boom-stand-3-5x-90x-magnification-w-80-led-light>: HTTP status code is not handled or not allowed
2026-01-10 19:43:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-square-table-with-4-chairs-natural-table-w-navy-poly-chairs>: HTTP status code is not handled or not allowed
2026-01-10 19:43:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mc-digital-vacuum-gauge-with-bluetooth-wireless-technology>: HTTP status code is not handled or not allowed
2026-01-10 19:43:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mc-two-stage-vacuum-pump-8-cfm>: HTTP status code is not handled or not allowed
2026-01-10 19:43:45 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/medical_laboratory_cold_storage/laboratory_cold_storage/laboratory_freezers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/medical_laboratory_cold_storage/laboratory_cold_storage/laboratory_freezers landed on page that is not a product page.
2026-01-10 19:43:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anatomical-chart-acupuncture-ear-laminated>: HTTP status code is not handled or not allowed
2026-01-10 19:43:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j-style-wire-organizer-systems-channel-mas00205-black>: HTTP status code is not handled or not allowed
2026-01-10 19:43:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ct-usa-endurance-desk-w-laminate-top-36-inch-x-24-inch-midnight-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:43:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cd-rewritable-media-ver95156-cd-rw-media-12x-speed-700-mb-capcity>: HTTP status code is not handled or not allowed
2026-01-10 19:43:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10000-currency-band-pmc55010-yellow-1000-box>: HTTP status code is not handled or not allowed
2026-01-10 19:43:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbk-athletic-work-shoe-knit-black-dark-grey-4m>: HTTP status code is not handled or not allowed
2026-01-10 19:43:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inner-ring-for-shell-type-needle-roller-bearing-metric-25mm-bore-30mm-od-205mm-width>: HTTP status code is not handled or not allowed
2026-01-10 19:43:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/75000-resin-fiber-disc-3-pak-7-8-arbor-24-grit-4-1-2>: HTTP status code is not handled or not allowed
2026-01-10 19:43:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbk-athletic-work-shoe-dual-layer-stretch-mesh-upper-black-dark-grey-9w>: HTTP status code is not handled or not allowed
2026-01-10 19:43:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-filterregulator-lubricator-upwl4-12-npt-3000-flow-lmin>: HTTP status code is not handled or not allowed
2026-01-10 19:43:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbk-athletic-work-shoe-dual-layer-stretch-mesh-upper-black-dark-grey-6-5m>: HTTP status code is not handled or not allowed
2026-01-10 19:43:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss316-62010-1-class-150-tee-stainless-steel-316>: HTTP status code is not handled or not allowed
2026-01-10 19:43:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss316-62006-34-class-150-tee-stainless-steel-316>: HTTP status code is not handled or not allowed
2026-01-10 19:43:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss304-63730-3-class-150-cap-stainless-steel-304>: HTTP status code is not handled or not allowed
2026-01-10 19:44:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbk-athletic-work-shoe-breathable-mesh-black-9w>: HTTP status code is not handled or not allowed
2026-01-10 19:44:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pneumatic-mobile-stool-without-back-18-22h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:44:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f36820-0001-plastic-triangular-scraper-9-34-length-4-38-blade-1pk>: HTTP status code is not handled or not allowed
2026-01-10 19:44:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pilot-head-for-vulcan-412063-2>: HTTP status code is not handled or not allowed
2026-01-10 19:44:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gas-control-valve-1-2-inch-24v-for-southbend-1175016>: HTTP status code is not handled or not allowed
2026-01-10 19:44:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pmb-temperature-calibration-kit-10700010636>: HTTP status code is not handled or not allowed
2026-01-10 19:44:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ml-a1107-anodized-aluminum-safety-padlock-1-1-2-inchw-3-inchtall-shackle-keyed-alike-black>: HTTP status code is not handled or not allowed
2026-01-10 19:44:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15440 pages (at 100 pages/min), scraped 6514 items (at 47 items/min)
2026-01-10 19:44:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u1226-5a-premium-locker-five-tier-12x12x12-5-doors-assembled-parchment>: HTTP status code is not handled or not allowed
2026-01-10 19:44:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-products-refine-16g-60l-half-round-waste-container-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:44:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u1282-3a-me-black-tie-locker-triple-tier-12x18x24-3-doors-assembled-black>: HTTP status code is not handled or not allowed
2026-01-10 19:44:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/400-series-solid-door-wardrobe-cabinet-48wx24dx72h-parchment-assembled>: HTTP status code is not handled or not allowed
2026-01-10 19:44:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-chrome-2-tier-slant-wire-shelving-starter-unit-36w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:44:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-chrome-2-tier-wire-shelving-add-on-unit-60w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 19:44:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pick-pole-with-stainless-steel-pick-hook-te-013-120-0587-hardwood-handle-10-1-2>: HTTP status code is not handled or not allowed
2026-01-10 19:44:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indexing-plunger-mini-w-hidden-lock-lock-out-zinc-5-0-18-0n-pressure-m10-1-thread-7-7mm-pin>: HTTP status code is not handled or not allowed
2026-01-10 19:44:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-ton-aluminum-service-jack-rapid-rise-dual-pump>: HTTP status code is not handled or not allowed
2026-01-10 19:44:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tsv1260-grn-12-x-60-shadow-board-green-vinyl-self-adhesive-tape-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:44:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/695-6-caster-set-w-brakes-solid-polypropylene-hd-black-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:44:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/49-storagemaster-rolling-work-bench-1000-lbs-steel-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:44:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-r-b-wire-front-load-wire-laundry-cart-double-pole-rack-2-25-bushel-chrome>: HTTP status code is not handled or not allowed
2026-01-10 19:44:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sliding-door-roller-assembly-1-1-8-steel-ball-bearing>: HTTP status code is not handled or not allowed
2026-01-10 19:44:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sliding-door-pull-6-1-2-hc-wood-handle-diecast-black>: HTTP status code is not handled or not allowed
2026-01-10 19:44:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-8-bushel-antimicrobial-vinyl-basket-truck-all-swivel-casters-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:44:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pistol-case-with-1911-inserts-qf300bk0s-watertight-10-11-16-x9-3-4-x4-13-16-black>: HTTP status code is not handled or not allowed
2026-01-10 19:44:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pistol-case-qf345bk-watertight-10-11-16-x9-3-4-x4-13-16-black>: HTTP status code is not handled or not allowed
2026-01-10 19:44:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-10-bushel-vinyl-bumper-truck-2-rigid-2-swivel-casters-forest-green>: HTTP status code is not handled or not allowed
2026-01-10 19:44:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-14-bushel-ups-fedex-able-vinyl-basket-all-swivel-casters-red>: HTTP status code is not handled or not allowed
2026-01-10 19:44:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tt-esd-rubber-matting-mt2472-24x72x0080-royal-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:44:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tt-esd-rubber-matting-mt3060-30x60x0080-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:44:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-14-bushel-vinyl-bumper-truck-all-swivel-casters-red>: HTTP status code is not handled or not allowed
2026-01-10 19:44:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/horizon-mfg-1-compartment-clear-hair-net-beard-cover-shoe-cover-arm-protector-dispenser-no-hole>: HTTP status code is not handled or not allowed
2026-01-10 19:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/carts-trucks/bulk_container_trucks_tilt_trucks/basket_trucks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:44:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbwp-16-bushel-vinyl-bumper-truck-2-rigid-2-swivel-casters-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:44:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/horizon-mfg-60-pair-ear-plug-dispenser-with-lid-holds-10-pair-safety-glasses-5136-w-6l>: HTTP status code is not handled or not allowed
2026-01-10 19:44:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tap-die-set-b44718-black-oxide-40-piece>: HTTP status code is not handled or not allowed
2026-01-10 19:44:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fixed-non-ventilated-curb-5acc32ft-32-1-2-square-x12h-galvanized-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:44:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/little-giant-174-aerial-safety-cage-8-14-w-click-casters-18515-240>: HTTP status code is not handled or not allowed
2026-01-10 19:44:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-safety-netting-for-144-in-bay-j-hook-attachment-440-lbs-black>: HTTP status code is not handled or not allowed
2026-01-10 19:44:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blower-wheel-10-3-4-dia-x-1-7-8w-for-garland-g02952-01p>: HTTP status code is not handled or not allowed
2026-01-10 19:44:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-yuasa-enersys-np12-12-12v-12ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:44:47 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/carts-trucks/bulk_container_trucks_tilt_trucks/basket_trucks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/carts-trucks/bulk_container_trucks_tilt_trucks/basket_trucks landed on page that is not a product page.
2026-01-10 19:44:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fuse-300v-60a-for-hatco-r020303302>: HTTP status code is not handled or not allowed
2026-01-10 19:44:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-upg-sel-cp0660-6v-5ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:44:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-mk-es5-12sa-12v-5ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:44:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-csb-evx12340-evx-12340-12v-35ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:44:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-small-brush-for-hepa-backpack-vacuum-641754>: HTTP status code is not handled or not allowed
2026-01-10 19:44:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-office-partition-panel-with-partial-window-60-1-4-w-x-73-1-2-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:44:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cha-procedure-accessory-package-1>: HTTP status code is not handled or not allowed
2026-01-10 19:44:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/run-capacitor-40-mfd-440v-oval>: HTTP status code is not handled or not allowed
2026-01-10 19:44:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/run-capacitor-70-plus-5-mfd-440v-round>: HTTP status code is not handled or not allowed
2026-01-10 19:44:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/27-series-versatrac-4-1-4height-3-high-temp-nylon-wheel-rigid-caster>: HTTP status code is not handled or not allowed
2026-01-10 19:44:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-x-2-pinnacle-thermoplastic-wheel-with-roller-bearing-for-1-2-axle-1000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:45:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/75-series-10-1-8height-3w-8-phenolic-wheel-with-cam-wheel-brake-swivel-caster>: HTTP status code is not handled or not allowed
2026-01-10 19:45:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-2-step-tilt-roll-ladder-serrated-grating-tr2g>: HTTP status code is not handled or not allowed
2026-01-10 19:45:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/800071-wht-1-opaque-plastic-hook-50-pack-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:45:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dti-frock-serged-seams-elastic-wrists-white-sm-30-qty>: HTTP status code is not handled or not allowed
2026-01-10 19:45:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/122030-horizontal-wall-mount-sign-holder-w-adhesive-tape-8-5-x-5-5-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:45:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/501l-05-model-501l-with-flow-rate-of-05-gpm>: HTTP status code is not handled or not allowed
2026-01-10 19:45:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/172722-acrylic-hanging-poster-frame-28-x-22-acrylic>: HTTP status code is not handled or not allowed
2026-01-10 19:45:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/300626-wide-slanted-chrome-wire-basket-for-pegboard-slatwall-24-25-x-10-metal>: HTTP status code is not handled or not allowed
2026-01-10 19:45:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wern-roofing-bag-kit-baseware-harness-w-tongue-buckle-legs-50-feet-rope-lifeline-backpack>: HTTP status code is not handled or not allowed
2026-01-10 19:45:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15539 pages (at 99 pages/min), scraped 6561 items (at 47 items/min)
2026-01-10 19:45:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/252012-countertop-tri-fold-brochure-holder-4-x-7-25-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:45:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/252311-4-tier-letter-size-countertop-brochure-holder-9-x-16-5-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/lockers/gear_lockers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:45:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700018-suction-cups-1-75-diameter-20-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:45:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wern-twinleg-self-retracting-lifeline-spacer>: HTTP status code is not handled or not allowed
2026-01-10 19:45:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/703389-gre-4-sided-interlocking-pegboard-display-8-x-60-green-opaque>: HTTP status code is not handled or not allowed
2026-01-10 19:45:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beam-mount-clamp-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:45:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/701202-2-5-attached-back-0-148-diameter-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:45:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vs-mst-digital-magnetic-stirrer-100-240v-50-60hz>: HTTP status code is not handled or not allowed
2026-01-10 19:45:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700220-gre-12-pegboard-revolving-countertop-display-4-sided-green>: HTTP status code is not handled or not allowed
2026-01-10 19:45:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/771360-blu-pegboard-wall-panel-13-5-x-60-blue-opaque>: HTTP status code is not handled or not allowed
2026-01-10 19:45:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700223-blu-36-pegboard-revolving-floor-display-4-sided-blue-translucent>: HTTP status code is not handled or not allowed
2026-01-10 19:45:23 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/lockers/gear_lockers> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/lockers/gear_lockers landed on page that is not a product page.
2026-01-10 19:45:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700406-org-four-sided-spinning-pegboard-floor-display-w-wheels-16-x-60-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:45:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700350-clr-pegboard-powerwing-13-75-x-44-clear>: HTTP status code is not handled or not allowed
2026-01-10 19:45:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/703388-wht-4-sided-interlocking-pegboard-display-w-wheels-8-x-40-white-solid>: HTTP status code is not handled or not allowed
2026-01-10 19:45:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/igg-precision-combination-squares-w-18-inch-blade-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 19:45:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/igg-digital-micrometer-w-alloy-gold-anodized-friction-thimble-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 19:45:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/igg-tri-point-internal-bore-gauge-ip54-0-315-0-40-inch-0-001mm-0-00005-inch-accuracy-0-00015-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:45:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hyflex-light-weight-gloves-ansell-11-618-black-pu-palm-coat-size-9>: HTTP status code is not handled or not allowed
2026-01-10 19:45:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ch-reversible-3-8-inch-air-drill-keyless>: HTTP status code is not handled or not allowed
2026-01-10 19:45:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sds-rotary-hammer-kit-30-ah-dch213l2-0-4100-bpm-0-1100-rpm-20vmax-105l>: HTTP status code is not handled or not allowed
2026-01-10 19:45:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/right-angle-drill-driver-tool-only-dcd740b-20vmax-3-8-chuck-0-650-0-2000-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:45:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infinity-3-tier-3-door-locker-15-in-w-x-15-in-d-x-24-in-h-gray-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 19:45:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-office-partition-panel-with-partial-window-60-1-4w-x-76h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:45:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-electric-office-partition-panel-with-partial-window-48-1-4w-x-77-1-2h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:45:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fao-deluxe-bleeding-control-wall-station-single-kit-up-to-24-persons>: HTTP status code is not handled or not allowed
2026-01-10 19:45:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conductive-kitting-tray-lid-13-13-16l-x-9-7-16w-x-1-16h>: HTTP status code is not handled or not allowed
2026-01-10 19:45:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/trayp548-spillage-tray-for-48w-ductless-fume-hood-48w-x-1h-x-22d>: HTTP status code is not handled or not allowed
2026-01-10 19:45:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-step-aluminum-rolling-ladder-24inw-ribbed-tread-21ind-top-step-w-o-handrails>: HTTP status code is not handled or not allowed
2026-01-10 19:45:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/circuit-board-shipping-and-storage-box-w-foam-13-1-2l-x-10-7-8w-x-2-3-4h>: HTTP status code is not handled or not allowed
2026-01-10 19:45:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-step-aluminum-rolling-ladder-24inw-ribbed-tread-28ind-top-step-32in-handrails>: HTTP status code is not handled or not allowed
2026-01-10 19:45:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-series-swivel-plate-caster-205256445-brk5-rubber-total-lock-brake-5dia-325-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:45:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protective-pak-static-dissipative-foam-inside-16-3-4l-x-9-3-4w-x-1-4h>: HTTP status code is not handled or not allowed
2026-01-10 19:45:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-series-swivel-plate-caster-4061099497-mold-on-polyurethane-6dia-1200-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:45:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-series-swivel-plate-caster-406109929-brk7-ss-polyurethane-with-brake-6dia-900-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:45:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/no-wire-test-tube-half-rack-187480016-polypropylene-16mm-30-places-white>: HTTP status code is not handled or not allowed
2026-01-10 19:45:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wash-bottle-117320008-ldpe-1000ml-capacity-isopropanol-4-pk-yellow-cap-wide-mouth>: HTTP status code is not handled or not allowed
2026-01-10 19:45:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-8-hex-nut-grade-5-carbon-steel-plain-coarse-pkg-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/bolts/flange_bolts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:45:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/color-coded-exercise-putty-xx-soft-tan-90cc>: HTTP status code is not handled or not allowed
2026-01-10 19:45:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/recumbent-stepper>: HTTP status code is not handled or not allowed
2026-01-10 19:45:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-exercise-putty-blue-firm-2-ounce>: HTTP status code is not handled or not allowed
2026-01-10 19:45:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sparkle-exercise-putty-red-light-1-pound>: HTTP status code is not handled or not allowed
2026-01-10 19:45:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medway-niche-nch18x38me-1634w-x-18ow-x-3114h-x-614d>: HTTP status code is not handled or not allowed
2026-01-10 19:46:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-exercise-putty-green-4-ounce-medium>: HTTP status code is not handled or not allowed
2026-01-10 19:46:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-5-tools-4-x-5-lb-putties-medium-yellow-red-green-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:46:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/designer-wood-locker-33365-triple-tier-3-wide-12w-x-15d-x-24h-maple-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 19:46:04 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/fasteners/bolts/flange_bolts> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/fasteners/bolts/flange_bolts landed on page that is not a product page.
2026-01-10 19:46:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/side-panel-33335-for-21d-designer-wood-locker-without-sloping-hood-cherry>: HTTP status code is not handled or not allowed
2026-01-10 19:46:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/side-panel-33333-for-18d-designer-wood-locker-without-sloping-hood-maple>: HTTP status code is not handled or not allowed
2026-01-10 19:46:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ehs18x-nsf-14x10-ehs18x-nsf-14x10>: HTTP status code is not handled or not allowed
2026-01-10 19:46:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/learnfit-mobile-sit-stand-adjustable-desk-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:46:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-exerciser-black-x-heavy>: HTTP status code is not handled or not allowed
2026-01-10 19:46:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15635 pages (at 96 pages/min), scraped 6605 items (at 44 items/min)
2026-01-10 19:46:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xtrainer-gel-hand-exerciser-blue-advanced>: HTTP status code is not handled or not allowed
2026-01-10 19:46:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-metal-venturi-blower-9518-08-100-psig-5435>: HTTP status code is not handled or not allowed
2026-01-10 19:46:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inflatable-balance-stone-17-5-cm-7-diameter-colors-vary>: HTTP status code is not handled or not allowed
2026-01-10 19:46:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/84w-x-30d-machine-base-3500lb-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 19:46:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/loaded-gear-cx-600-tactical-belt-bi12254-black>: HTTP status code is not handled or not allowed
2026-01-10 19:46:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-mesh-folding-container-21-1-2-l-x-12-1-8-w-x-9-3-8-h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:46:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-ton-bridge-crane-10-bridge-length-23-run-length-12-height-4-col>: HTTP status code is not handled or not allowed
2026-01-10 19:46:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-stp-steel-safe-roll-lad-wgt-act-lock-24-w-exp-stp-org-wa113214x-o>: HTTP status code is not handled or not allowed
2026-01-10 19:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/plumbing/plumbing_parts_accessories/toilet_urinal_carriers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:46:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conntek-1f515520-1-power-adapter-cord-with-5-15p-male-plug-to-5-15-20r-female-connector>: HTTP status code is not handled or not allowed
2026-01-10 19:46:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibration-shock-absorption-mounts-cylindrical-type-1-00-142-max-load>: HTTP status code is not handled or not allowed
2026-01-10 19:46:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9in-x-1-2in-100-polyester-roller-cover-with-a-rod-and-cap-frame-24-case-9ap050-rcap>: HTTP status code is not handled or not allowed
2026-01-10 19:46:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/non-electric-office-partition-panel-with-raceway-24-1-4w-x-46h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:46:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slice-ceramic-blade-auto-retractable-pen-cutter-10512>: HTTP status code is not handled or not allowed
2026-01-10 19:46:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/902003-1-1-2c-3-ton-deep-throat-ratchet-leverage-press>: HTTP status code is not handled or not allowed
2026-01-10 19:46:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/41304-swipe-cards-51-100>: HTTP status code is not handled or not allowed
2026-01-10 19:46:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-watercraft-cleaning-kit-sw81100>: HTTP status code is not handled or not allowed
2026-01-10 19:46:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dubnoff-shaking-water-bath-dub-15-15-liters>: HTTP status code is not handled or not allowed
2026-01-10 19:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/plumbing/plumbing_parts_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:46:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-bag-filter-nylon-mesh-7-3-50-dia-x-32-l-150-micron-steel-ring-pkg-qty-50>: HTTP status code is not handled or not allowed
2026-01-10 19:46:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sewn-liquid-bag-filter-polyester-multifilament-4-1-8-x-14-250-micron-steel-ring-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 19:46:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-liquid-bag-filter-polyester-felt-4-1-8-x-14-1-micron-plastic-flange-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 19:46:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-bag-filter-plyst-felt-7-3-50-dia-x-16-1-2-l-200-micron-plastic-sure-seal-ring-pkg-qty-50>: HTTP status code is not handled or not allowed
2026-01-10 19:46:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-bag-filter-poly-p-felt-7-3-50-dia-x-32-l-25-micron-plastic-sure-seal-ring-pkg-qty-50>: HTTP status code is not handled or not allowed
2026-01-10 19:46:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5mm-hex-l-wrench-long-12164>: HTTP status code is not handled or not allowed
2026-01-10 19:46:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bonus-pack-balldriver-l-wrench-set-10937-gorillagrip-fold-up-set-12589>: HTTP status code is not handled or not allowed
2026-01-10 19:46:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-32-x-3-8-security-machine-screw-button-torx-head-18-8-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:46:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-liquid-bag-filter-polypropylene-felt-6-d-x-22-l-75-micron-plastic-flange-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 19:46:38 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/plumbing/plumbing_parts_accessories> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/plumbing/plumbing_parts_accessories landed on page that is not a product page.
2026-01-10 19:46:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4mm-balldriver-power-bit-10860>: HTTP status code is not handled or not allowed
2026-01-10 19:46:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sewn-liquid-bag-filter-polypropylene-monofil-8-x-30-250-micron-plastic-flange-pkg-50>: HTTP status code is not handled or not allowed
2026-01-10 19:46:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-24-x-1-1-2-spanner-machine-screw-oval-head-18-8-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:46:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-partition-panel-with-partial-window-and-pass-thru-cable-36-1-4w-x-76h-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:46:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5mm-balldriver-t-handle-13164>: HTTP status code is not handled or not allowed
2026-01-10 19:46:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orbit-irrigation-27999-indoor-outdoor-sprinkler-timer-9-station>: HTTP status code is not handled or not allowed
2026-01-10 19:46:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m5-x-0-8-x-35mm-spanner-machine-screw-flat-head-18-8-stainless-steel-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:46:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-9-tamperproof-torx-power-bit>: HTTP status code is not handled or not allowed
2026-01-10 19:46:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-conditioner-weatherseal-2-14-2-14-42>: HTTP status code is not handled or not allowed
2026-01-10 19:46:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/w4-tamperproof-tri-wing-power-bit>: HTTP status code is not handled or not allowed
2026-01-10 19:46:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/propanel-light-gray-42h-x-36w-panel>: HTTP status code is not handled or not allowed
2026-01-10 19:46:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-8-bspp-silencer-resin-body-pa66-felt-87-psi-14-to-122-f>: HTTP status code is not handled or not allowed
2026-01-10 19:46:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/needle-valve-5mm-tube-x-1-8-metal-release-collet-knob-adjustmet>: HTTP status code is not handled or not allowed
2026-01-10 19:46:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelving-72w-x-14d-x-14h-1-shelf-starter-chrome>: HTTP status code is not handled or not allowed
2026-01-10 19:46:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-pc-short-paddle-with-out-holes-red>: HTTP status code is not handled or not allowed
2026-01-10 19:46:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelving-30w-x-18d-x-63h-4-shelf-add-on-chrome>: HTTP status code is not handled or not allowed
2026-01-10 19:46:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultradrain-circular-seal-plus-20inches-diameter>: HTTP status code is not handled or not allowed
2026-01-10 19:46:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelving-48w-x-24d-x-63h-4-shelf-starter-chrome>: HTTP status code is not handled or not allowed
2026-01-10 19:47:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-top-hotplate-6-25-6-25-square-top-120v>: HTTP status code is not handled or not allowed
2026-01-10 19:47:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wire-shelf-level-30w-x-24d-chrome>: HTTP status code is not handled or not allowed
2026-01-10 19:47:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/i-telesystem-6-multipoint-stirrer-with-telemodul-40-c-controller>: HTTP status code is not handled or not allowed
2026-01-10 19:47:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transport-bag-tamper-evident-6w-6l>: HTTP status code is not handled or not allowed
2026-01-10 19:47:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-189269gz-54w-x-24d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:47:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/i-telemodul-20-c-controller-130-1400-rpm-100-240v>: HTTP status code is not handled or not allowed
2026-01-10 19:47:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rt-basic-magnetic-stirrer-8-66-diameter-top-plate-5l-capacity-100-240v>: HTTP status code is not handled or not allowed
2026-01-10 19:47:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-2-mil-pull-tite-double-drawstring-bag-12w-18l>: HTTP status code is not handled or not allowed
2026-01-10 19:47:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15734 pages (at 99 pages/min), scraped 6651 items (at 46 items/min)
2026-01-10 19:47:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/linear-low-density-white-opaque-trash-liners-10-mil-10-15-gal-24w-32l>: HTTP status code is not handled or not allowed
2026-01-10 19:47:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-189251gz-42w-x-18d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 19:47:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-plate-platform-kit-12-x-18-x-18>: HTTP status code is not handled or not allowed
2026-01-10 19:47:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/full-size-test-tube-rack-clamp-for-17-20mm-tubes-4-x-10-array-white>: HTTP status code is not handled or not allowed
2026-01-10 19:47:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usb-headset-981000014-noise-cancelling-mic-8-cord-black-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:47:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graphic-calculator-ti84plus-usb-cable-3-1-3-x-7-1-2-x-9-10-black>: HTTP status code is not handled or not allowed
2026-01-10 19:47:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-48-w-x-48-d-x-84-h-add-on-3-shelf-levels-steel-deck-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:47:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/compact-digital-rocker-7-to-13-degree-rocking-angle-100-240v-50-60hz>: HTTP status code is not handled or not allowed
2026-01-10 19:47:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/block-for-digital-drybath-88880029-holds-12-18mm-dia-tubes>: HTTP status code is not handled or not allowed
2026-01-10 19:47:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/300ml-erlenmeyer-flask-clamp-30155-for-use-with-maxq-shaker-platforms>: HTTP status code is not handled or not allowed
2026-01-10 19:47:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/legacy-120-racetrack-conference-table-with-power-data-grommet-ash-grey>: HTTP status code is not handled or not allowed
2026-01-10 19:47:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-series-wheel-20000355-3-1-2-x-1-1-4-polyolefin-3-8-annular-ball-bearing-black>: HTTP status code is not handled or not allowed
2026-01-10 19:47:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-72-w-x-48-d-x-96-h-add-on-3-shelf-levels-wood-deck-sand>: HTTP status code is not handled or not allowed
2026-01-10 19:47:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-48-w-x-48-d-x-72-h-add-on-3-shelf-levels-steel-deck-sand>: HTTP status code is not handled or not allowed
2026-01-10 19:47:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/westcott-13140-kids-scissors-5-blunt-pack-of-12-assorted>: HTTP status code is not handled or not allowed
2026-01-10 19:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:47:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/westcott-19016-kleencut-shears-leftright-hand-6-black>: HTTP status code is not handled or not allowed
2026-01-10 19:47:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s1201sgaf-clear-1000-series-clear-anti-fog-lens-20ea-cs>: HTTP status code is not handled or not allowed
2026-01-10 19:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:47:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-72-w-x-24-d-x-120-h-add-on-3-shelf-levels-steel-deck-sand>: HTTP status code is not handled or not allowed
2026-01-10 19:47:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-96-w-x-36-d-x-84-h-starter-3-shelf-levels-wood-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:47:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lockout-tagout-hasps-5501-1-opening-red>: HTTP status code is not handled or not allowed
2026-01-10 19:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/hand_tools_1/hand_saws_cutting_tools_scrapers/knives_blades/folding_knives already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:47:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alera-aleva634432mc-valencia-series-bookcase-3-shelves-31-34w-x-14d-x-39-38h-medium-cherry>: HTTP status code is not handled or not allowed
2026-01-10 19:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_bookcases_hutches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:47:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-48-w-x-24-d-x-96-h-add-on-3-shelf-levels-steel-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:47:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2781014-spring-ratchet-for-anthony-international-california>: HTTP status code is not handled or not allowed
2026-01-10 19:47:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/150i-direct-heat-co2-incubator-with-tc-sensor-120v-50-60hz>: HTTP status code is not handled or not allowed
2026-01-10 19:47:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-72-w-x-24-d-x-96-h-starter-3-shelf-levels-wood-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:47:34 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks landed on page that is not a product page.
2026-01-10 19:47:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-inch-x-20-foot-fertilizer-solution-suction-discharge-hose-assembly-w-c-x-e-aluminum-cam>: HTTP status code is not handled or not allowed
2026-01-10 19:47:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-ton-low-profile-jack-f-767>: HTTP status code is not handled or not allowed
2026-01-10 19:47:36 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks landed on page that is not a product page.
2026-01-10 19:47:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-ton-air-actuated-bottle-jack-18204c>: HTTP status code is not handled or not allowed
2026-01-10 19:47:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/storage/utility_racks/bulk_storage_racks>: HTTP status code is not handled or not allowed
2026-01-10 19:47:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/hand_tools_1/hand_saws_cutting_tools_scrapers/knives_blades/folding_knives>: HTTP status code is not handled or not allowed
2026-01-10 19:47:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/office/desks_workstations/desk_components_accessories/desk_bookcases_hutches>: HTTP status code is not handled or not allowed
2026-01-10 19:47:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-storage-rack-96-w-x-24-d-x-72-h-starter-3-shelf-levels-wood-deck-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:47:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/261517-disc-holder-with-knife>: HTTP status code is not handled or not allowed
2026-01-10 19:47:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-powder-exercise-band-silver-50-yard-roll-1-roll-box>: HTTP status code is not handled or not allowed
2026-01-10 19:47:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/y1-01-75-payloader-4-wheel-two-passenger-48v-burden-carrier>: HTTP status code is not handled or not allowed
2026-01-10 19:47:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/681152-fan-motor>: HTTP status code is not handled or not allowed
2026-01-10 19:47:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcr-safety-v201r-orange-safety-vest-2-reflective-strips-polyester-side-straps-one-size>: HTTP status code is not handled or not allowed
2026-01-10 19:47:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-hawk-2-ton-foldable-engine-crane-bh8026>: HTTP status code is not handled or not allowed
2026-01-10 19:47:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omega-25-ton-hydraulic-floor-axle-jack-23225>: HTTP status code is not handled or not allowed
2026-01-10 19:47:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exercise-band-loop-10-long-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:47:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-28-14w-mobile-cabinet-7-drawer72-compart-bright-blue-individual-lock>: HTTP status code is not handled or not allowed
2026-01-10 19:47:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-40-14w-drawer-cabinet-8-drawer-117-compart-bright-blue-no-lock>: HTTP status code is not handled or not allowed
2026-01-10 19:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/wire_cable/electrical_wire_cable already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:47:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-free-exercise-tubing-blue-25-roll-bag>: HTTP status code is not handled or not allowed
2026-01-10 19:47:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-ah18n-nexelon-utility-cart-handle-18w>: HTTP status code is not handled or not allowed
2026-01-10 19:47:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quickflex-welding-cable-202206-025-1-0-gauge-25-ft-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:47:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-powder-exercise-tubing-black-25-bag>: HTTP status code is not handled or not allowed
2026-01-10 19:47:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-al436s-stainless-steel-wire-ledge-36l-x-4h>: HTTP status code is not handled or not allowed
2026-01-10 19:47:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2261059-basket-round-85-inch-od-x-5-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 19:47:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-straight-clamp-terminal-protectors-5773-025b-3-0-4-0-gauge-25-pcs>: HTTP status code is not handled or not allowed
2026-01-10 19:48:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-powder-exercise-tubing-tan-100-roll-box>: HTTP status code is not handled or not allowed
2026-01-10 19:48:01 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/wire_cable/electrical_wire_cable> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/wire_cable/electrical_wire_cable landed on page that is not a product page.
2026-01-10 19:48:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-174-restaurant-lunchroom-square-bar-height-table-42-x-42-x-42-h-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 19:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/electrochemistry_meters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:48:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brazed-seam-ring-terminal-copper-lugs-107112-100-6-gauge-1-4-stud>: HTTP status code is not handled or not allowed
2026-01-10 19:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/wiring_devices/wire_connectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:48:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90-bent-magnalugs-6430-050hl-1-2-50-pcs>: HTTP status code is not handled or not allowed
2026-01-10 19:48:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ironwood-solid-door-wood-storage-cabinet-natural-oak-color-finish>: HTTP status code is not handled or not allowed
2026-01-10 19:48:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-replacement-cutter-head-536142-seal-bolt-cutter>: HTTP status code is not handled or not allowed
2026-01-10 19:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:48:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-free-pre-cut-exercise-band-xx-light-tan-48-l-strips-box-of-40>: HTTP status code is not handled or not allowed
2026-01-10 19:48:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ironwood-2-compartment-wardrobe-storage-cabinet-solid-door-folkstone-color>: HTTP status code is not handled or not allowed
2026-01-10 19:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/wiring_devices/wire_connectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:48:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15823 pages (at 89 pages/min), scraped 6680 items (at 29 items/min)
2026-01-10 19:48:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1171028-bushing-hex-3-8-x-1-4-inch-npt>: HTTP status code is not handled or not allowed
2026-01-10 19:48:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/441655-contactor-for-blodgett-oven>: HTTP status code is not handled or not allowed
2026-01-10 19:48:12 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/electrochemistry_meters> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/electrochemistry_meters landed on page that is not a product page.
2026-01-10 19:48:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/70436-11-waterfed-deck-scrub-soft-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:48:13 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/wiring_devices/wire_connectors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/wiring_devices/wire_connectors landed on page that is not a product page.
2026-01-10 19:48:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-free-exercise-band-6-yard-roll-box-5-color-set>: HTTP status code is not handled or not allowed
2026-01-10 19:48:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2061270-bowl-cutter-w-lid-blade-for-robot-coupe>: HTTP status code is not handled or not allowed
2026-01-10 19:48:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/71606-24-single-blade-ultra-hygiene-squeegee-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:48:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/321326-gasket1-3-16-inch-x-5-8-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:48:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/cable_management/cable_ties_wraps landed on page that is not a product page.
2026-01-10 19:48:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/53546-216-0-5-tube-brush-for-flex-rod-medium-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:48:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/wiring_devices/wire_connectors>: HTTP status code is not handled or not allowed
2026-01-10 19:48:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/262337-locknut1-inch-zinc>: HTTP status code is not handled or not allowed
2026-01-10 19:48:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/263692-burner-i-r-salamander-for-american-range>: HTTP status code is not handled or not allowed
2026-01-10 19:48:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fieldpro-purofort-full-safety-boots-steel-toe-14h-size-9-black>: HTTP status code is not handled or not allowed
2026-01-10 19:48:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5551304-ust-detail-brush-soft-red>: HTTP status code is not handled or not allowed
2026-01-10 19:48:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-extra-heavy-duty-surface-mounted-towel-bar-24-w>: HTTP status code is not handled or not allowed
2026-01-10 19:48:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/98013-1-color-coding-rubber-band-x5-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:48:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/barnstead-ultrapure-and-oxygen-removal-cartridge-d8809-full-size-1-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:48:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-surface-mounted-multi-roll-tissue-dispenser-w-shelf>: HTTP status code is not handled or not allowed
2026-01-10 19:48:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-surface-mounted-single-tissue-dispenser-w-hood>: HTTP status code is not handled or not allowed
2026-01-10 19:48:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-cubicle-collection-surface-mounted-single-tissue-dispenser>: HTTP status code is not handled or not allowed
2026-01-10 19:48:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seapro-purofort-full-safety-boots-steel-toe-15h-size-12-blueyellow>: HTTP status code is not handled or not allowed
2026-01-10 19:48:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-classicseries-heavy-duty-shower-curtain-rod-36-w>: HTTP status code is not handled or not allowed
2026-01-10 19:48:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eathm10s1p-ind-composite-vibration-dampening-extended-air-hammer2100-bpm-16-cfm-14-inlet>: HTTP status code is not handled or not allowed
2026-01-10 19:48:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/650066-82-oz-hand-scoop-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:48:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eatdr05s1p-industrial-12-reversible-air-drill-6-cfm-14-inlet>: HTTP status code is not handled or not allowed
2026-01-10 19:48:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bishamon-pallet-truck-pallet-jack-5500-lb-capacity-27-x-36>: HTTP status code is not handled or not allowed
2026-01-10 19:48:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6269-16-fiberglass-extension-handle>: HTTP status code is not handled or not allowed
2026-01-10 19:48:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dandux-canvas-basket-truck-bulk-truck-10-bushel-white>: HTTP status code is not handled or not allowed
2026-01-10 19:48:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42u-server-cabinet-vertical-rail-kit-10-32-tapped>: HTTP status code is not handled or not allowed
2026-01-10 19:48:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/56871-3-gallon-bucket-lid-pink>: HTTP status code is not handled or not allowed
2026-01-10 19:48:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-shelf-liner-30w-x-14d-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:48:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powered-24-w-x-10-l-belt-conveyor-with-6-h-side-rails>: HTTP status code is not handled or not allowed
2026-01-10 19:48:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bobrick-1-1-2-dia-straight-peened-grab-bar-18-w>: HTTP status code is not handled or not allowed
2026-01-10 19:48:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/681361-blower-motor-for-frymaster>: HTTP status code is not handled or not allowed
2026-01-10 19:48:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/53725-hook-brush-medium-white>: HTTP status code is not handled or not allowed
2026-01-10 19:48:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1292203-filter-grease-20-inch-x-25-inch-aluminum-hr>: HTTP status code is not handled or not allowed
2026-01-10 19:48:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clip-on-dust-mop-handle-metal-1-18-x-60-h600m>: HTTP status code is not handled or not allowed
2026-01-10 19:48:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-x-18-x-60-phenolic-locker-z-style-graphite-grafix>: HTTP status code is not handled or not allowed
2026-01-10 19:48:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-1785-plug-orifice-72-5-16-inch-32-thread>: HTTP status code is not handled or not allowed
2026-01-10 19:48:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/29343-6-mini-handle-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:48:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clearance-lettering-non-reflective-black-letter>: HTTP status code is not handled or not allowed
2026-01-10 19:48:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1681393-hinge-door-universal-for-frymaster>: HTTP status code is not handled or not allowed
2026-01-10 19:48:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/disposable-polyester-filter-12-w-x-25-h-x-1-d>: HTTP status code is not handled or not allowed
2026-01-10 19:48:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2c-18-7-26bc-unsh-type-cmp>: HTTP status code is not handled or not allowed
2026-01-10 19:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/tools/welding/arc_welding/tig_welding already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:48:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1681330-o-ring-drain-valve-pack-4-for-frymaster>: HTTP status code is not handled or not allowed
2026-01-10 19:48:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stronghold-ventilated-all-around-cabinet-60-x-24-x-66>: HTTP status code is not handled or not allowed
2026-01-10 19:48:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hinged-duct-access-door-24-x-24>: HTTP status code is not handled or not allowed
2026-01-10 19:49:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1292173-filter-grease-25-inch-x-20-inch-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 19:49:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/77-90176-flat-elbow-5l-x-2-58w-x-5h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:49:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-stacker-li-truck-1000-lb-capacity-with-32-x-30-platform-3>: HTTP status code is not handled or not allowed
2026-01-10 19:49:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-stacker-li-truck-1000-lb-capacity-with-adjustable-30-forks-3>: HTTP status code is not handled or not allowed
2026-01-10 19:49:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fir-plywood-premium-grade-crate-premium94-46-95-collapsible-inside-94l-x-46w-x-95>: HTTP status code is not handled or not allowed
2026-01-10 19:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/compartment_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:49:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/tools/welding/arc_welding/tig_welding>: HTTP status code is not handled or not allowed
2026-01-10 19:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/cabinets/compartment_cabinets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:49:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-access-door-12-x-12>: HTTP status code is not handled or not allowed
2026-01-10 19:49:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/69616-3-scraper-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:49:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-30-shop-top-work-bench-adjustable-height-1-1-2-top>: HTTP status code is not handled or not allowed
2026-01-10 19:49:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 15920 pages (at 97 pages/min), scraped 6719 items (at 39 items/min)
2026-01-10 19:49:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-height-stainless-steel-floor-lock-4-5-6-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:49:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bolted-teardrop-pallet-rack-starter-96inw-x-42ind-x-96inh-3230-lbs-shelf-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:49:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bolted-teardrop-pallet-rack-starter-96inw-x-42ind-x-144inh-3230-lbs-shelf-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:49:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/original-wrist-and-ankle-weight-4-lb-turquoise>: HTTP status code is not handled or not allowed
2026-01-10 19:49:16 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/cabinets/compartment_cabinets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/cabinets/compartment_cabinets landed on page that is not a product page.
2026-01-10 19:49:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-indoor-outdoor-stackable-chair-copper>: HTTP status code is not handled or not allowed
2026-01-10 19:49:16 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/cabinets/compartment_cabinets> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/cabinets/compartment_cabinets landed on page that is not a product page.
2026-01-10 19:49:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/americana-climbing-wind-safety-helmet-type-2-4-point-mega-ratchet-suspension-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:49:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-wrist-and-ankle-weight-3-lb-gold->: HTTP status code is not handled or not allowed
2026-01-10 19:49:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2221033-blade-for-waring-products>: HTTP status code is not handled or not allowed
2026-01-10 19:49:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contractor-heater-3>: HTTP status code is not handled or not allowed
2026-01-10 19:49:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forkli-able-shipping-container-with-lid-42-x-42-2>: HTTP status code is not handled or not allowed
2026-01-10 19:49:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-sectional-stackbin-unit-37-w-8-d-x-4-1-2-h-blue-8-compartments>: HTTP status code is not handled or not allowed
2026-01-10 19:49:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strapping-dispenser-poly-strapping-300-seals-tools-1>: HTTP status code is not handled or not allowed
2026-01-10 19:49:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-wire-black-powder-coat-fence-1>: HTTP status code is not handled or not allowed
2026-01-10 19:49:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2041145-element-food-warmer-120v-550w-for-hatco-corp>: HTTP status code is not handled or not allowed
2026-01-10 19:49:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-steel-flange-and-steel-insert-for-2-tubing-w-polished-stainless-steel-canopy>: HTTP status code is not handled or not allowed
2026-01-10 19:49:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1211117-leveler-non-skid-3-8-16-thd>: HTTP status code is not handled or not allowed
2026-01-10 19:49:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/urbanite-57000-series-wall-traffic-barricade-with-panel-legs-72l-x-3w-x-38h-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:49:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-adult-ankle-weight-10-lb-blue-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 19:49:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-oxford-insulated-safety-bib-overall-3xl-fluorescent-green>: HTTP status code is not handled or not allowed
2026-01-10 19:49:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-bar-mount-bracket-for-15-tubing-polished-brass>: HTTP status code is not handled or not allowed
2026-01-10 19:49:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-basket-28-liter-with-wire-handle-2>: HTTP status code is not handled or not allowed
2026-01-10 19:49:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cmc05018-machine-screw>: HTTP status code is not handled or not allowed
2026-01-10 19:49:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/28-1090-lever-waste-drain-body-bushing>: HTTP status code is not handled or not allowed
2026-01-10 19:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/electrochemistry_meters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:49:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/63-h-nexel-chrome-wire-shelving-add-on-72-w-x-36-d>: HTTP status code is not handled or not allowed
2026-01-10 19:49:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insulated-safety-bib-overall-s-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:49:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-5-inch-1-piece-utility-tong-plain>: HTTP status code is not handled or not allowed
2026-01-10 19:49:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insulated-safety-bib-overall-xl-black>: HTTP status code is not handled or not allowed
2026-01-10 19:49:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1031024-gasket-blower-box-for-ultrafryer>: HTTP status code is not handled or not allowed
2026-01-10 19:49:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-spaghetti-tong>: HTTP status code is not handled or not allowed
2026-01-10 19:49:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-ball-tee-for-2-tubing-satin-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:49:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-scroll-finial-for-2-tubing-polished-brass>: HTTP status code is not handled or not allowed
2026-01-10 19:49:47 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/electrochemistry_meters> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/medical-lab/lab_equipment_instruments/electrochemistry_meters landed on page that is not a product page.
2026-01-10 19:49:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/381633-terminal-block-for-cres-cor>: HTTP status code is not handled or not allowed
2026-01-10 19:49:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-in-ceiling-mount-fan-8402-cfm>: HTTP status code is not handled or not allowed
2026-01-10 19:49:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/22-1121-2-inch-dial-kit-off-1-10>: HTTP status code is not handled or not allowed
2026-01-10 19:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/safety_railings_fittings/architectural_railing_components already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:49:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-in-wall-ceiling-mount-fan-7185-cfm>: HTTP status code is not handled or not allowed
2026-01-10 19:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/anchors_hangers/wedge_anchors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:49:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-ball-tee-side-outlet-for-15-tubing-satin-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:49:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-flush-cross-fitting-for-15-tubing-satin-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:49:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bmj06040-socket-cap-screw>: HTTP status code is not handled or not allowed
2026-01-10 19:49:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/relaxed-fit-flex-twill-cargo-pants-34l-inseam-x-34-waist-black>: HTTP status code is not handled or not allowed
2026-01-10 19:49:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-7-stud-wedge-anchor-steel-hot-dip-galvanized-pkg-of-25>: HTTP status code is not handled or not allowed
2026-01-10 19:49:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelite-vented-plastic-mat-shelf-truck-54l-x-18w-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:49:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-l-bin-rail-workstation-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:50:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industries-ball-cross-for-2-tubing-polished-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:50:00 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/safety_railings_fittings/architectural_railing_components> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/safety/safety_railings_machine_guards/safety_railings_fittings/architectural_railing_components landed on page that is not a product page.
2026-01-10 19:50:01 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/fasteners/anchors_hangers/wedge_anchors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/fasteners/anchors_hangers/wedge_anchors landed on page that is not a product page.
2026-01-10 19:50:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sl0900302-t5ho-fluorescent-grow-light-kit-24w-6400k-nanotech-reflector-2-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:50:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-adjustable-one-piece-seal-med-blue-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:50:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-pressboard-folders-with-two-pocket-dividers-letter-six-section-yellow-10box>: HTTP status code is not handled or not allowed
2026-01-10 19:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/file_folders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:50:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-file-folders-13-cut-first-positions-one-ply-top-tab-legal-manila-100box>: HTTP status code is not handled or not allowed
2026-01-10 19:50:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1100lb-drum-scale>: HTTP status code is not handled or not allowed
2026-01-10 19:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/classification_folders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:50:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vollrath-classic-stainless-steel-stock-pot-24-qt>: HTTP status code is not handled or not allowed
2026-01-10 19:50:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/54-h-nexel-chrome-wire-shelving-add-on-54-w-x-18-d>: HTTP status code is not handled or not allowed
2026-01-10 19:50:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16016 pages (at 96 pages/min), scraped 6759 items (at 40 items/min)
2026-01-10 19:50:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evaporative-whole-room-humidifier-evap40-4-gallon-1000-sq-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:50:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vermiculite-coated-fiberglass-welding-blanket-10w-x-10h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:50:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010401-gasket-proofer-for-star-manufacturing>: HTTP status code is not handled or not allowed
2026-01-10 19:50:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viseaccessories-wilton14830>: HTTP status code is not handled or not allowed
2026-01-10 19:50:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/file_folders> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/file_folders landed on page that is not a product page.
2026-01-10 19:50:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hubbel-low-pressure-air-water-50-1>: HTTP status code is not handled or not allowed
2026-01-10 19:50:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6221106-screw-mach-th-ss-100>: HTTP status code is not handled or not allowed
2026-01-10 19:50:17 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/classification_folders> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/office-school-supply/folders_filing/folders/classification_folders landed on page that is not a product page.
2026-01-10 19:50:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1071049-faucet-inlet-1-2-inch-nps-m-1-2slp-for-fisher-manufacturing>: HTTP status code is not handled or not allowed
2026-01-10 19:50:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-insulated-hydro-parka-jacket-l-black>: HTTP status code is not handled or not allowed
2026-01-10 19:50:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/53-cut-a-way-rescue-tube-red-with-guard-in-white-10-204-red>: HTTP status code is not handled or not allowed
2026-01-10 19:50:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-ripstop-fleece-lined-safety-jacket-5xl-fluorescent-green>: HTTP status code is not handled or not allowed
2026-01-10 19:50:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/74-h-nexel-chrome-wire-shelving-42-w-x-24-d>: HTTP status code is not handled or not allowed
2026-01-10 19:50:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-strapping-5-8-x-033-x-3500-black-16-x-6-core>: HTTP status code is not handled or not allowed
2026-01-10 19:50:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-2-accordion-expansion-wallet-elastic-cord-ltr-bluegreenredyellow-50box>: HTTP status code is not handled or not allowed
2026-01-10 19:50:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fireproof-4-drawer-vertical-file-cabinet-legal-31-9-16-lx20-13-16-wx52-3-4-h-parchment>: HTTP status code is not handled or not allowed
2026-01-10 19:50:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pediatric-pack-10-118>: HTTP status code is not handled or not allowed
2026-01-10 19:50:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oxygen-cylinder-bag-10-109>: HTTP status code is not handled or not allowed
2026-01-10 19:50:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clamps-hargrave-20302>: HTTP status code is not handled or not allowed
2026-01-10 19:50:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1981179-insert-slant-knife-for-edlund>: HTTP status code is not handled or not allowed
2026-01-10 19:50:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sled-base-stack-chair-with-seat-and-back-pad-400-lb-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 19:50:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-tuff-hanging-folder-with-easy-slide-tab-legal-standard-green-20pack>: HTTP status code is not handled or not allowed
2026-01-10 19:50:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1661240-relay-mercury-208-240v>: HTTP status code is not handled or not allowed
2026-01-10 19:50:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-economical-file-jackets-1-12-expansion-letter-11-point-manila-50box>: HTTP status code is not handled or not allowed
2026-01-10 19:50:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-2-box-bottom-pressboard-hanging-folder-letter-standard-green-25box>: HTTP status code is not handled or not allowed
2026-01-10 19:50:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-125mm-bore-x-90mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:50:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smead-hanging-file-folders-untabbed-11-point-stock-legal-green-25box>: HTTP status code is not handled or not allowed
2026-01-10 19:50:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-63mm-bore-x-175mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:50:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chicago-pneumatic-3-8-reversible-pistol-drill-cp9790-0-37-hp-3-8-chuck>: HTTP status code is not handled or not allowed
2026-01-10 19:50:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/86-h-nexel-chrome-wire-shelving-48-w-x-24-d>: HTTP status code is not handled or not allowed
2026-01-10 19:50:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paraffin-bath-6-lb-capacity-18l-x-12w-x-10d>: HTTP status code is not handled or not allowed
2026-01-10 19:50:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-wire-shelving-60-w-x-24-d-x-86-h>: HTTP status code is not handled or not allowed
2026-01-10 19:50:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2531269-lamps-led-exit-sign-retro-2-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:50:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18awg-4c-stranded-control-cable-plenum-cmp-1000-ft-box-white>: HTTP status code is not handled or not allowed
2026-01-10 19:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelf_hardware/wire_shelving_hardware already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:50:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cheesecloth-individual-retail-package-4-sq-yards-per-bag-1>: HTTP status code is not handled or not allowed
2026-01-10 19:50:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/understanding-chemical-hazards-dvd-program>: HTTP status code is not handled or not allowed
2026-01-10 19:50:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rwg52m-kamori-leather-gloves-w-aramid-liner-cut-a4-1-pair-white-m>: HTTP status code is not handled or not allowed
2026-01-10 19:50:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-stage-carpet-96l-x-36w-x-24h-red>: HTTP status code is not handled or not allowed
2026-01-10 19:50:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012072-knob-indicator-for-blodgett-oven>: HTTP status code is not handled or not allowed
2026-01-10 19:50:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dishwashing-glove-large-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:50:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-125mm-bore-x-170mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:50:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-125mm-bore-x-5mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:50:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-solid-galvanized-shelf-cart-36x24-2-shelves-800-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:50:56 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelf_hardware/wire_shelving_hardware> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelf_hardware/wire_shelving_hardware landed on page that is not a product page.
2026-01-10 19:50:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-tube-reducer-89700-04-53-14-stem-x-532-push-to-connect-tube>: HTTP status code is not handled or not allowed
2026-01-10 19:50:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-80mm-bore-x-100mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:50:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-63mm-bore-x-80mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:50:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waffle-weave-bar-towel-18x18>: HTTP status code is not handled or not allowed
2026-01-10 19:51:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-wide-span-rack-72x24x60-gray-with-3-shelves-laminated-deck-900-lb-cap-per-level>: HTTP status code is not handled or not allowed
2026-01-10 19:51:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedy-board-dock-board-15>: HTTP status code is not handled or not allowed
2026-01-10 19:51:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-poly-oxford-lined-safety-parka-jacket-xxs-fluorescent-green>: HTTP status code is not handled or not allowed
2026-01-10 19:51:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-additional-level-wide-span-rack-96x24-wood-deck-1100-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:51:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-safety-parka-jacket-3xlt-fluorescent-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:51:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-50mm-bore-x-90mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:51:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-wire-shelving-42-w-x-24-d-x-63-h>: HTTP status code is not handled or not allowed
2026-01-10 19:51:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ecos-liquid-laundry-detergent-free-clear-2x-5-gallon-pail>: HTTP status code is not handled or not allowed
2026-01-10 19:51:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-32mm-bore-x-160mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:51:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16117 pages (at 101 pages/min), scraped 6803 items (at 44 items/min)
2026-01-10 19:51:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-6432-double-acting-magnetic-cylinder-25mm-bore-x-25mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:51:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-quilted-safety-freezer-jacket-s-fluorescent-orange>: HTTP status code is not handled or not allowed
2026-01-10 19:51:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-15552-double-acting-magnetic-cylinder-40mm-bore-x-350mm-stroke>: HTTP status code is not handled or not allowed
2026-01-10 19:51:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beanie-watch-cap-xl-moss>: HTTP status code is not handled or not allowed
2026-01-10 19:51:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-quilted-safety-freezer-jacket-5xl-black>: HTTP status code is not handled or not allowed
2026-01-10 19:51:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-density-silverware-bags-flat-packed-with-flip-top-closure-10-x-325-05-mil-lldpe>: HTTP status code is not handled or not allowed
2026-01-10 19:51:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-wire-shelving-add-on-24-w-x-24-d-x-74-h>: HTTP status code is not handled or not allowed
2026-01-10 19:51:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moto-vest-4-pockets-cottonpolyester-l-dark-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:51:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1421377-brush-cleaning-20-inch-blk-handle-for-carlisle-foodservice-products>: HTTP status code is not handled or not allowed
2026-01-10 19:51:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-12-inch-id-x-2-18-inch-od-x-0093-inch-steel-arbor-spacer-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:51:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-extra-shelving-48x24x96-with-5-shelves-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:51:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1132-inch-id-x-1316-inch-od-x-0020-inch-steel-arbor-shim-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:51:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-heavy-duty-shelving-48x18x60-with-5-shelves-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:51:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/38-inch-id-x-58-inch-od-x-00015-inch-steel-arbor-shim-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:51:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eagle-hazmat-cabinet-self-close-60-gallon>: HTTP status code is not handled or not allowed
2026-01-10 19:51:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-tear-drop-upright-frame-bolted-120h-x-36d-24571-lbs-cap-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:51:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1831222-sprocket-1-2-8-pack-vct-2010-for-roundup-food-equipment>: HTTP status code is not handled or not allowed
2026-01-10 19:51:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eagle-type-i-safety-can-2-gallon-funnel-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:51:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eagle-type-i-safety-can-2-gallons-green>: HTTP status code is not handled or not allowed
2026-01-10 19:51:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-step-roll-fold-steel-rolling-ladder-perforated-tread>: HTTP status code is not handled or not allowed
2026-01-10 19:51:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/finish-thompson-ss-centrifugal-pump-3-impeller-tefc-motor-1>: HTTP status code is not handled or not allowed
2026-01-10 19:51:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-heavy-duty-shelving-48x24x84-with-5-shelves-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:51:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-piece-rectangular-keystock-assortment-zinc-plated-12-inch-length>: HTTP status code is not handled or not allowed
2026-01-10 19:51:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5mm-square-metric-keystock-plain-finish-1-meter-length>: HTTP status code is not handled or not allowed
2026-01-10 19:51:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/finish-thompson-48-drum-pump-kit-pvdf-tube-iconel-shaft-air-motor>: HTTP status code is not handled or not allowed
2026-01-10 19:51:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1591168-brush-head-phu-7-3-4-inch-w>: HTTP status code is not handled or not allowed
2026-01-10 19:51:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1421383-brush-tank-16-inch-l-5-inch-od-for-carlisle-foodservice-products>: HTTP status code is not handled or not allowed
2026-01-10 19:51:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-steel-transfer-tank-100-gal-l-tank-long-bl-29211581>: HTTP status code is not handled or not allowed
2026-01-10 19:51:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-record-storage-with-boxes-1>: HTTP status code is not handled or not allowed
2026-01-10 19:51:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-male-elbow-60110-05-02-516-tube-x-18-swift-fit-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:51:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30107-plastic-barrier-chain-on-a-reel-hdpe-1-5-x200-6-38mm-gold>: HTTP status code is not handled or not allowed
2026-01-10 19:51:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/female-elbow-89105-04-02-14-tube-x-18-nptf-female-metallic-release-collet>: HTTP status code is not handled or not allowed
2026-01-10 19:51:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0702325-6-408-osy-epoxy-coated-gate-valve>: HTTP status code is not handled or not allowed
2026-01-10 19:51:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50066-p-plastic-barrier-chain-in-a-pail-hdpe-2-x160-8-51mm-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:51:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moisture-detector-3-cr2032-batteries-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:51:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deposit-vault-mailbox-and-parcel-drop-with-pedestal-dvcs0030-rear-access-copper-vein>: HTTP status code is not handled or not allowed
2026-01-10 19:51:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-mount-in-ground-post-for-weekend-away-mail-protector-dvjr0060-dvcs0070-dvjr0060pi-sand>: HTTP status code is not handled or not allowed
2026-01-10 19:51:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-20-ga-48-wx12-dx97-h-open-clip-style-6-shelf>: HTTP status code is not handled or not allowed
2026-01-10 19:51:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50010-500-plastic-barrier-chain-hdpe-2-x500-8-51mm-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:51:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parcel-protector-vault-mailbox-and-parcel-drop-dvu0050-rear-access-sand>: HTTP status code is not handled or not allowed
2026-01-10 19:51:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m12-x-1-75-x-40mm-socket-head-cap-screw-304-stainless-steel-pkg-of-25>: HTTP status code is not handled or not allowed
2026-01-10 19:51:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012219-hose-fitting-for-cleveland-range>: HTTP status code is not handled or not allowed
2026-01-10 19:52:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sting-relief-wipes-hydrocortisone-packs-for-smartcompliance-cabinet-30box>: HTTP status code is not handled or not allowed
2026-01-10 19:52:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/341708-booster-element-208v-6000w-for-hubbell-the-electric-heater-co>: HTTP status code is not handled or not allowed
2026-01-10 19:52:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2271105-caster-ofe-w-brake-for-henny-penny>: HTTP status code is not handled or not allowed
2026-01-10 19:52:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-branch-tee-55210-8-38-8mm-tube-x-38-swift-fit-composite-body>: HTTP status code is not handled or not allowed
2026-01-10 19:52:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd80sn-916-inch-band-heavy-duty-4-pc-hose-clamp-2-12-inch-5-716-inch-clmpg-diam-10-pcs>: HTTP status code is not handled or not allowed
2026-01-10 19:52:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chill-its-8934-ranger-hat-with-neck-shade-lxl-lime>: HTTP status code is not handled or not allowed
2026-01-10 19:52:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-20-ga-48-wx12-dx73-h-closed-clip-style-5-shelf-starter>: HTTP status code is not handled or not allowed
2026-01-10 19:52:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-36-1-door-outdoor-enclosed-corkboard-radius-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:52:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m5-x-0-8-x-10mm-machine-screw-phillips-flat-head-304-stainless-steel-din-965-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:52:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16216 pages (at 99 pages/min), scraped 6852 items (at 49 items/min)
2026-01-10 19:52:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-x-48-3-door-outdoor-enclosed-illuminated-corkboard-aluminum-frame>: HTTP status code is not handled or not allowed
2026-01-10 19:52:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-locker-triple-tier-12x18x24-9-door-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:52:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-work-shirt-m-tall-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:52:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1221029-kason-10174c00004-latch-w-strike-lk-for-kason>: HTTP status code is not handled or not allowed
2026-01-10 19:52:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-work-shirt-xl-long-tall-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:52:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-upper-tape-head-carton-sealing-head-pullback-spring-for-412560>: HTTP status code is not handled or not allowed
2026-01-10 19:52:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-48-tefc-1ph-1725rpm-c4c17fc9cc>: HTTP status code is not handled or not allowed
2026-01-10 19:52:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reynolds-wrap-pop-up-interfolded-aluminum-foil-sheets-12-x-10-34-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:52:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b104hsp-300-series-ss-hose-clamp-5-inch-7-inch-clamping-diameter-box-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:52:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd12s-916-inch-band-heavy-duty-3-pc-hose-clamp-916-inch-1-14-inch-clampingdiam-10-pcs>: HTTP status code is not handled or not allowed
2026-01-10 19:52:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-143-tefc-1ph-1740rpm-c143c17fb3kk>: HTTP status code is not handled or not allowed
2026-01-10 19:52:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-hot-box-bulk-material-heat-oven-hb54-1200-54-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/foodservice_disposables/disposable_plates_bowls already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:52:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-56-tefc-1ph-3450rpm-c6c34fc14kk>: HTTP status code is not handled or not allowed
2026-01-10 19:52:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-unicoil-hose-bender-for-34-inch-id-109-inch-max-od-hose>: HTTP status code is not handled or not allowed
2026-01-10 19:52:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-tecgen-flame-resistant-coverall-4xl-tall-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:52:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-xenoy-safety-padlock-key-different-2>: HTTP status code is not handled or not allowed
2026-01-10 19:52:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fork-extension-storage-rack>: HTTP status code is not handled or not allowed
2026-01-10 19:52:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-helix-work-shirt-2xl-tall-dark-khaki>: HTTP status code is not handled or not allowed
2026-01-10 19:52:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pliers-irwin-vise-grip-2078406>: HTTP status code is not handled or not allowed
2026-01-10 19:52:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s9834-5w-a19-led-220-bean-spread-medium-base-5000k>: HTTP status code is not handled or not allowed
2026-01-10 19:52:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-x-2-inch-x-0005-inch-stainless-steel-slotted-shim-pack-of-20>: HTTP status code is not handled or not allowed
2026-01-10 19:52:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solo-cup-company-plastic-souffle-portion-cups-2oz-translucent-250bag>: HTTP status code is not handled or not allowed
2026-01-10 19:52:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blue-plastic-box-truck-14-bushel-medium-duty>: HTTP status code is not handled or not allowed
2026-01-10 19:52:35 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/foodservice/foodservice_disposables/disposable_plates_bowls> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/foodservice/foodservice_disposables/disposable_plates_bowls landed on page that is not a product page.
2026-01-10 19:52:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1751107-hanger-basket-retro-kit-sg14-for-magikitchen-products>: HTTP status code is not handled or not allowed
2026-01-10 19:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/bookcases already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:52:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6221424-screw-mach-th-ss-100>: HTTP status code is not handled or not allowed
2026-01-10 19:52:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-knives-irwin-2089100>: HTTP status code is not handled or not allowed
2026-01-10 19:52:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-hang-type-magnetic-sweeper-48-w>: HTTP status code is not handled or not allowed
2026-01-10 19:52:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/size-b-3-inch-x-3-inch-stainless-steel-slotted-shim-260-piece-full-assortment>: HTTP status code is not handled or not allowed
2026-01-10 19:52:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-stacking-bin-clear-7>: HTTP status code is not handled or not allowed
2026-01-10 19:52:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-coated-scrim-reinforced-paper-roll-50-50pc-48-x-200-yds-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:52:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vci-co-extruded-gusseted-bags-58-x-48-x-110-4-mil-blue-20-bags-per-roll>: HTTP status code is not handled or not allowed
2026-01-10 19:52:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-flame-resistant-14th-zip-fleece-sweatshirt-s-tall-black>: HTTP status code is not handled or not allowed
2026-01-10 19:52:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frameless-glass-showcase-full-vision-36w-x-16d-x-72h-2-shelves>: HTTP status code is not handled or not allowed
2026-01-10 19:52:46 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/shelving/bookcases> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/shelving/bookcases landed on page that is not a product page.
2026-01-10 19:52:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protect-it-7-outlet-7ft-2350-joules>: HTTP status code is not handled or not allowed
2026-01-10 19:52:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-tear-drop-pallet-rack-starter-144w-x-42d-x-120h>: HTTP status code is not handled or not allowed
2026-01-10 19:52:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spku-lift-universal-forklift-spill-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:52:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/74-1193-magnetic-door-gasket-21-9-16-inch-x-59-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:52:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-8-outlet-osha-yellow-15ft>: HTTP status code is not handled or not allowed
2026-01-10 19:52:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1200va-smart-pro-rack-tower-digital-lcd-8-outlet>: HTTP status code is not handled or not allowed
2026-01-10 19:52:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-321-stainless-steel-tool-wrap-width-24-inch-length-50-thickness-0002-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:52:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/litefit-standard-harness-tongue-buckle-legs-xxl>: HTTP status code is not handled or not allowed
2026-01-10 19:52:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-321-stainless-steel-tool-wrap-width-20-inch-length-50-thickness-0002-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:52:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/executive-aluminum-storage-case-exc-110-s-11l-x-8-1-2w-x-7-3-4h-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:52:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-double-air-actuated-valve-pilot-spring-centered-pressure-center-g1-8-ports>: HTTP status code is not handled or not allowed
2026-01-10 19:52:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/decoil-stretch-lanyard-6l-snaphooks-w-rebar-hook>: HTTP status code is not handled or not allowed
2026-01-10 19:52:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-carabiner-1-2>: HTTP status code is not handled or not allowed
2026-01-10 19:52:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tire-changer-nylon-mountdemount-duckhead-with-round-hole>: HTTP status code is not handled or not allowed
2026-01-10 19:52:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010417-basket-hanger>: HTTP status code is not handled or not allowed
2026-01-10 19:53:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extension-wand-18-gallon-wet-dry-squeegee-vacuum>: HTTP status code is not handled or not allowed
2026-01-10 19:53:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-dock-board-with-steel-curbs-10>: HTTP status code is not handled or not allowed
2026-01-10 19:53:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/canopy-kit-with-convenience-outlet-brass-finish>: HTTP status code is not handled or not allowed
2026-01-10 19:53:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1681502-kit-element-install-kit-fv-for-frymaster>: HTTP status code is not handled or not allowed
2026-01-10 19:53:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/321863-gh-2680zh-large-spindle-bore-lathe-w-acu-rite-200s-dro>: HTTP status code is not handled or not allowed
2026-01-10 19:53:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012758-motor-conveyor-drive200-230v-60hz-3ph-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 19:53:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-dock-plate-4268-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:53:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/06570-1-8-x-2-x-6-plastic-masonry-shim-6218-504pc>: HTTP status code is not handled or not allowed
2026-01-10 19:53:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-horizontallamp-support-clip>: HTTP status code is not handled or not allowed
2026-01-10 19:53:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/22-1104-7-inch-door-latch-with-strike-curved-handle-and-adjustable-offset>: HTTP status code is not handled or not allowed
2026-01-10 19:53:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-halogen-socket-w-8-in-leads>: HTTP status code is not handled or not allowed
2026-01-10 19:53:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16312 pages (at 96 pages/min), scraped 6886 items (at 34 items/min)
2026-01-10 19:53:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cegb-led-exit-sign-black-green-letters-w-ni-cad-battery>: HTTP status code is not handled or not allowed
2026-01-10 19:53:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/relevance-walnut-round-coffee-table>: HTTP status code is not handled or not allowed
2026-01-10 19:53:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-panel-display-tower-5-ft-9-inch-high-fabric-sand>: HTTP status code is not handled or not allowed
2026-01-10 19:53:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/06435-1-4-x-1-x-2-plastic-masonry-shim-2114-1020pc>: HTTP status code is not handled or not allowed
2026-01-10 19:53:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/06060-1-2-x-2-5-16-x-3-plastic-horseshoe-shim-solid-22s-150pc>: HTTP status code is not handled or not allowed
2026-01-10 19:53:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cu2rc-led-white-emergency-unit-w-adjustable-heads-remote-capability>: HTTP status code is not handled or not allowed
2026-01-10 19:53:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-leg-workbench-with-fixed-height-legs-4>: HTTP status code is not handled or not allowed
2026-01-10 19:53:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/264072-shredder-disc-1-2-inch-for-uniworld-foodservice>: HTTP status code is not handled or not allowed
2026-01-10 19:53:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flannel-fabric-guest-chair-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:53:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/46-round-bar-height-table-with-4-seats-in-ground-mount-perforated-pattern-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:53:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-inch-x-12-inch-x-12-inch-corrugated-boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:53:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ptfe-single-turn-backup-ring-dash-121-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:53:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plain-deep-fixture-canopy-chrome-finish1-1-16-in-center-hole>: HTTP status code is not handled or not allowed
2026-01-10 19:53:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-flat-washer-uss-3-8-i-d-064-08-thick-steel-yellow-zinc-grade-8-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:53:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/261035-twin-basket-12-1-8l-6-3-8w-5-3-8d>: HTTP status code is not handled or not allowed
2026-01-10 19:53:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-length-squeeze-disher-47401-terracotta-0-65-oz-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:53:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-internal-tooth-lock-washer-grade-2-steel-zinc-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:53:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/madison-ipe-wood-outdoor-trash-can-with-flat-top-lid-36-gallon-capacity-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:53:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/261910-kason-11248000004-hinge-for-kason>: HTTP status code is not handled or not allowed
2026-01-10 19:53:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-tube-fitting-nylon-plastic-straight-reducer-10mm-tube-od-x-6mm-tube-od>: HTTP status code is not handled or not allowed
2026-01-10 19:53:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-syringe-filter-0-22um-30mm-bulk-packed-non-sterile-100-case>: HTTP status code is not handled or not allowed
2026-01-10 19:53:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graphite-compression-packing-316w-x-316h-x-50-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:53:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-ft-extension-cord-16-2-spt-2-white>: HTTP status code is not handled or not allowed
2026-01-10 19:53:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2541033-shelf-19-3-4-inch-x-19-3-4-inch-for-glasspro>: HTTP status code is not handled or not allowed
2026-01-10 19:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/metric_three_phase_motors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:53:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-tube-fitting-nylon-plastic-tee-connector-8mm-tube-od>: HTTP status code is not handled or not allowed
2026-01-10 19:53:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprayed-inside-white-mushroom-glass-9-1-2-in-diameter>: HTTP status code is not handled or not allowed
2026-01-10 19:53:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fowler-1-inch-digital-counter-micrometer>: HTTP status code is not handled or not allowed
2026-01-10 19:53:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-split-lock-washer-21-64-i-d-3-32-thick-steel-galvanized-grade-2-pkg-of-100>: HTTP status code is not handled or not allowed
2026-01-10 19:53:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012340-grease-filter-stainless-steel-16-x-16>: HTTP status code is not handled or not allowed
2026-01-10 19:53:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-round-table-with-2-imme-armless-barstools-white-seatriver-cherry-top>: HTTP status code is not handled or not allowed
2026-01-10 19:53:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-75-plasteur-pasteur-pipet-bulk-packed-in-bags-non-sterile-500-case>: HTTP status code is not handled or not allowed
2026-01-10 19:53:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1000ul-extended-length-low-retention-filter-pipette-tips-racked-sterile-960-case>: HTTP status code is not handled or not allowed
2026-01-10 19:53:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arkadia-sauce-pot-cover-7393-14-20-24-quart-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:53:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8014170-hood-filter-type6-stainless-steel-25x20>: HTTP status code is not handled or not allowed
2026-01-10 19:53:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/redco-tomato-pro-w-o-safety-guard-0646n-3-8-cut-straight-blade>: HTTP status code is not handled or not allowed
2026-01-10 19:53:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/back-panel-36-x-97>: HTTP status code is not handled or not allowed
2026-01-10 19:53:38 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/metric_three_phase_motors> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/motors_power_transmission/electric_motors/general_purpose_electric_motors/metric_three_phase_motors landed on page that is not a product page.
2026-01-10 19:53:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/back-panel-48-x-73>: HTTP status code is not handled or not allowed
2026-01-10 19:53:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-1-1-2-hp-thru-bolt-115-230v>: HTTP status code is not handled or not allowed
2026-01-10 19:53:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reinforced-high-pressure-clear-pvc-tubing-12id-x-34od-x-10-ft>: HTTP status code is not handled or not allowed
2026-01-10 19:53:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fishing-retractable-gear-tether-0tr2-209-medium-36extention-black-carabiner>: HTTP status code is not handled or not allowed
2026-01-10 19:53:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/31560-16x20-ptfe-hood-filter-flame-gard-16-h-x20-w>: HTTP status code is not handled or not allowed
2026-01-10 19:53:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-1-1-2-hp-sq-flange-full>: HTTP status code is not handled or not allowed
2026-01-10 19:53:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/741340-gasket-true-for-true-manufacturing>: HTTP status code is not handled or not allowed
2026-01-10 19:53:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1291120-kason-67001002025-filter-hood-for-kason>: HTTP status code is not handled or not allowed
2026-01-10 19:53:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traex-dripcut-sugar-packet-holders-wr-1009-chrome-plated-w-o-handles>: HTTP status code is not handled or not allowed
2026-01-10 19:53:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-7-drawer-40-shallow-depth-mobile-cabinet-w-butcher-top-blue-master-keyed>: HTTP status code is not handled or not allowed
2026-01-10 19:53:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-30-esd-square-edge-work-bench-adjustable-height-1-1-4-top>: HTTP status code is not handled or not allowed
2026-01-10 19:53:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-8-drawer-standard-width-cabinet-gray-keyed-alike>: HTTP status code is not handled or not allowed
2026-01-10 19:53:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-8-drawer-standard-width-cabinet-blue-no-lock>: HTTP status code is not handled or not allowed
2026-01-10 19:53:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-9-drawer-standard-width-cabinet-blue-master-keyed-2>: HTTP status code is not handled or not allowed
2026-01-10 19:53:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-48-truck-chest-single-lid-black-79210992>: HTTP status code is not handled or not allowed
2026-01-10 19:53:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-hour-big-and-tall-mesh-back-chair-leather-black>: HTTP status code is not handled or not allowed
2026-01-10 19:53:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-in-coat-towel-rack-shelf-silver>: HTTP status code is not handled or not allowed
2026-01-10 19:53:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-9-drawer-standard-width-cabinet-gray-keyed-alike>: HTTP status code is not handled or not allowed
2026-01-10 19:53:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011562-filter-paper>: HTTP status code is not handled or not allowed
2026-01-10 19:53:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-thank-you-for-social-distancing-sign>: HTTP status code is not handled or not allowed
2026-01-10 19:53:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/341028-urn-heater240v-3000w-for-seco-products>: HTTP status code is not handled or not allowed
2026-01-10 19:53:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8nf34k-nylon-plastic-adjustable-lever-w-steel-components-m8-x-1-25-tapped-thread>: HTTP status code is not handled or not allowed
2026-01-10 19:53:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/induction-chafer-stand-46549-black>: HTTP status code is not handled or not allowed
2026-01-10 19:53:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-width-wall-mounted-hanger-style-coat-rack-sandstone>: HTTP status code is not handled or not allowed
2026-01-10 19:53:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j-series-pallet-jack-truck-36l-x-20-12w-5500-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:53:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1331066-filter-oil-15-3-4-inch-dia-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:53:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-drop-in-guard-rail-6-ft-with-2-brackets-and-hardware>: HTTP status code is not handled or not allowed
2026-01-10 19:54:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-container-without-lid-5>: HTTP status code is not handled or not allowed
2026-01-10 19:54:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-starter-rack-96x48x84-with-3-level-steel-deck-1500lb-cap-per-shelf-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:54:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-container-without-lid-23-1-2x15-1-2x12>: HTTP status code is not handled or not allowed
2026-01-10 19:54:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-starter-rack-48x24x96-with-3-levels-wood-deck-1500lb-cap-per-shelf-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:54:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-starter-rack-48x36x96-with-3-levels-wood-deck-1500lb-cap-per-shelf-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:54:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polycarbonate-jar-1606-02-7-oz-capacity-w-red-top>: HTTP status code is not handled or not allowed
2026-01-10 19:54:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arkadia-sauce-pot-cover-7396-60-quart>: HTTP status code is not handled or not allowed
2026-01-10 19:54:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g7-10-hp-rotary-screw-comp-120-gal-horiz-125-psig-3-phase-208-230-460v-w-dryer>: HTTP status code is not handled or not allowed
2026-01-10 19:54:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-round-table-with-4-imme-armless-chairs-sky-blue-seatdesigner-white-top>: HTTP status code is not handled or not allowed
2026-01-10 19:54:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-4vs-mill-200s-3q-acu-x-y-knee-powerfeed>: HTTP status code is not handled or not allowed
2026-01-10 19:54:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optio-brazier-3819-19-quart-capacity-15-3-4-diameter>: HTTP status code is not handled or not allowed
2026-01-10 19:54:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2171206-kit-pump-repair-f-217-1126-for-server-products>: HTTP status code is not handled or not allowed
2026-01-10 19:54:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/soot-cleaner-spray-soot-remover-spray-16-oz-1-qty>: HTTP status code is not handled or not allowed
2026-01-10 19:54:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16409 pages (at 97 pages/min), scraped 6907 items (at 21 items/min)
2026-01-10 19:54:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boiler-treatment-boiler-water-cleaner-ph-neutralizer-1-qt-1-qty>: HTTP status code is not handled or not allowed
2026-01-10 19:54:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-wear-strip-magliner-stair-climbers>: HTTP status code is not handled or not allowed
2026-01-10 19:54:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tri-ply-stainless-steel-stock-pot-77600-16-quart-capacity-8-1-2-depth>: HTTP status code is not handled or not allowed
2026-01-10 19:54:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/centurion-sauce-pots-3202-7-quart-6-depth>: HTTP status code is not handled or not allowed
2026-01-10 19:54:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-workmate-stand-ahwh2436>: HTTP status code is not handled or not allowed
2026-01-10 19:54:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjust-stepmate-stand-stainless-steel-ahwl2424ss>: HTTP status code is not handled or not allowed
2026-01-10 19:54:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supreme-anti-fatigue-mat-3-4-thick-6-x-2-black>: HTTP status code is not handled or not allowed
2026-01-10 19:54:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/handwash-starter-station>: HTTP status code is not handled or not allowed
2026-01-10 19:54:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-round-table-with-4-imme-armless-chairs-white-seatstudio-teak-top>: HTTP status code is not handled or not allowed
2026-01-10 19:54:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-square-table-with-4-imme-armless-barstools-moonbeam-seatmaple-top>: HTTP status code is not handled or not allowed
2026-01-10 19:54:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/690174-jvm-836-3-milling-machine-w-x-axis-powerfeed-1-1-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 19:54:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wear-ever-tapered-sauce-pan-434112-5-1-4-bottom-diameter-1-1-2-quart-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:54:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluted-double-wall-insulated-serving-bowls-47688-6-9-quart-round>: HTTP status code is not handled or not allowed
2026-01-10 19:54:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-packing-table-with-butcher-block-square-edge-top-70-x-36>: HTTP status code is not handled or not allowed
2026-01-10 19:54:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traex-plastic-flatware-cylinder-storage-system-52643-3-3-4-diameter-white>: HTTP status code is not handled or not allowed
2026-01-10 19:54:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbaum-fingerprint-lock-luxury-fire-res-safe-w-walnut-door-3-0-cu-ft-black-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:54:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/easy-adjust-boltless-shelf-truck-with-laminate-shelves-21>: HTTP status code is not handled or not allowed
2026-01-10 19:54:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/691202-jtm-4vs-milling-machine-w-3-axis-newall-dp700-dro-quill-3-hp>: HTTP status code is not handled or not allowed
2026-01-10 19:54:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/butt-splice-22-18-awg-red-75-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:54:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8014108-hood-filter-type6-alum-16x20-w-btm-bracket>: HTTP status code is not handled or not allowed
2026-01-10 19:54:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-1756-mesh-filter-20-inch-x-20-inch-x-2-inch>: HTTP status code is not handled or not allowed
2026-01-10 19:54:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-shelf-bracket>: HTTP status code is not handled or not allowed
2026-01-10 19:54:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traex-cutlery-box-52654-polyethylene-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:54:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strathmere-6-piece-woven-deep-seating-set-ocean-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:54:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1421652-handle-floor-brushfiberglass>: HTTP status code is not handled or not allowed
2026-01-10 19:54:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1691051-support-basket-10-3-4x11-1-2-for-keating>: HTTP status code is not handled or not allowed
2026-01-10 19:54:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48w-30d-mobile-production-workbench-with-power-apron-esd-safety-edge-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:54:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/short-ball-toggle-spst-6a-125v-o-f-leads>: HTTP status code is not handled or not allowed
2026-01-10 19:54:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-cable-tie-18-175-lb-50-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:54:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worldwide-electric-wpevhs40-18-324tp-16-5-vhs-motor-40hp-1800rpm-324tp-230-460v-wpi>: HTTP status code is not handled or not allowed
2026-01-10 19:54:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/battery-charging-clip-20-amp>: HTTP status code is not handled or not allowed
2026-01-10 19:54:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011036-infrared-burner>: HTTP status code is not handled or not allowed
2026-01-10 19:54:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2371065-gasket-milk-cooler-24-ft-for-beverage-air>: HTTP status code is not handled or not allowed
2026-01-10 19:54:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wiregard-174-yellow-84-small-jar-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:54:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-819wp-extreme-thermal-waterproof-winter-work-gloves-2xl-black>: HTTP status code is not handled or not allowed
2026-01-10 19:54:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lounge-chair-32-12w-x-30-12d-x-31h-black-framegray-seat>: HTTP status code is not handled or not allowed
2026-01-10 19:54:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wiregard-174-yellow-84-500-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:54:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-12-belt-sander>: HTTP status code is not handled or not allowed
2026-01-10 19:54:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/291837-7-flag-room-id-system-4-l-aluminum-flags-1-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:54:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/291832-2-flag-room-id-system-4-l-aluminum-flags-1-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:54:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/291831-1-flag-room-id-system-4-l-aluminum-flag-1-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:54:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-square-table-with-4-imme-armless-caster-chairs-light-gray-seatespresso-top>: HTTP status code is not handled or not allowed
2026-01-10 19:54:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2261040-basket-taco-shell-6-shell-for-prince-castle>: HTTP status code is not handled or not allowed
2026-01-10 19:54:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rw10-3s1y-lightweight-rain-jacket-hi-viz-lime-3xl>: HTTP status code is not handled or not allowed
2026-01-10 19:54:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-square-table-with-4-imme-armless-caster-chairs-white-seatstudio-teak-top>: HTTP status code is not handled or not allowed
2026-01-10 19:54:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/induction-buffet-station-4667680-natural-19-3-4-x-17-1-4-x-7-1-2>: HTTP status code is not handled or not allowed
2026-01-10 19:54:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-square-table-with-4-imme-armless-barstools-moonbeam-seatespresso-top>: HTTP status code is not handled or not allowed
2026-01-10 19:54:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1292148-filter-grease-12-inch-x-16-inch-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 19:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/safety/eye_protection/eyewear_cleaning_accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:54:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/341029-urn-heater208v-4000w>: HTTP status code is not handled or not allowed
2026-01-10 19:54:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/redco-instacut-3-1-2-corer-dicer-wedger-15003-4-section-wedge-cut-tabletop>: HTTP status code is not handled or not allowed
2026-01-10 19:54:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acry-fab-vertical-lid-holder-fml-3v-3-column-19-3-8-x-6-1-2-x-5-3-8>: HTTP status code is not handled or not allowed
2026-01-10 19:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/foodservice/appliances/refrigerators_freezers/refrigerators/refrigerated_merchandisers_display_cases already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:54:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fp90-deflector-disposable-foam-earplugs-33db-uncorded-light-green>: HTTP status code is not handled or not allowed
2026-01-10 19:54:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8014112-hood-filter-type6-alum-16x25-w-lock-handles>: HTTP status code is not handled or not allowed
2026-01-10 19:54:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fp91-deflector-disposable-foam-earplugs-33db-corded-light-green>: HTTP status code is not handled or not allowed
2026-01-10 19:54:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cipher153-guest-chair-with-cantilever-arms-casters-fabric-seat-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 19:54:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/31-400-20-inch-h-x-20-inch-w-x-2-inch-t-frameless-stainless-steel-hood-filter>: HTTP status code is not handled or not allowed
2026-01-10 19:54:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bb1168-full-mortise-five-knuckle-ball-bearing-heavy-weight-hinge-45-x-45-usp>: HTTP status code is not handled or not allowed
2026-01-10 19:54:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/341d-latch-protection-plate-with-lock-cut-out-2c>: HTTP status code is not handled or not allowed
2026-01-10 19:54:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-use-indoor-outdoor-small-yellow-box-2-lights-2-int-sensors-15-cord>: HTTP status code is not handled or not allowed
2026-01-10 19:54:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/miramar-13-high-dome-cover-49429-fits-49428-satin-finish>: HTTP status code is not handled or not allowed
2026-01-10 19:54:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/safety/eye_protection/eyewear_cleaning_accessories>: HTTP status code is not handled or not allowed
2026-01-10 19:54:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-step-angled-ladder-l65>: HTTP status code is not handled or not allowed
2026-01-10 19:54:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-step-flip-it-ladder-l5fi>: HTTP status code is not handled or not allowed
2026-01-10 19:55:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/foodservice/appliances/refrigerators_freezers/refrigerators/refrigerated_merchandisers_display_cases>: HTTP status code is not handled or not allowed
2026-01-10 19:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/door_window_hardware/insulation_film_weather_stripping already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:55:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mx54p-metromax-i-stationary-post-54>: HTTP status code is not handled or not allowed
2026-01-10 19:55:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ptp187-floor-stripe>: HTTP status code is not handled or not allowed
2026-01-10 19:55:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3653-grade-2-tubular-lock-entry-adj-2-38-to-2-34-us26d-arc-scc-kd-asa>: HTTP status code is not handled or not allowed
2026-01-10 19:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/packaging/bags_covers/poly_bags_tubing_sheeting/reclosable_bags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:55:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-1097-21-inch-cast-iron-burner-assembly>: HTTP status code is not handled or not allowed
2026-01-10 19:55:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elbow-module-cem>: HTTP status code is not handled or not allowed
2026-01-10 19:55:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mini-pro2-body-massager>: HTTP status code is not handled or not allowed
2026-01-10 19:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/fasteners/door_window_hardware/insulation_film_weather_stripping already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:55:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cliq153-office-chair-mid-back-17-22h-seat-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:55:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vpl901lensled-sign-projector-lens-only>: HTTP status code is not handled or not allowed
2026-01-10 19:55:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/framing-nails-fr131-3b-3-x-131-plastic-collated-coated-smooth-shank-2000-bx>: HTTP status code is not handled or not allowed
2026-01-10 19:55:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-w-x-30-d-x-12-h-stackbox-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:55:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vpl908led-sign-projector-with-lens>: HTTP status code is not handled or not allowed
2026-01-10 19:55:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16504 pages (at 95 pages/min), scraped 6927 items (at 20 items/min)
2026-01-10 19:55:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-electrodes-2-round-40-case>: HTTP status code is not handled or not allowed
2026-01-10 19:55:11 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/fasteners/door_window_hardware/insulation_film_weather_stripping> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/fasteners/door_window_hardware/insulation_film_weather_stripping landed on page that is not a product page.
2026-01-10 19:55:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/true-174-gdm-41sl-54-hc-ld-refrigerated-merchandiser-47-13-w-x-21-d-x-54-13-h>: HTTP status code is not handled or not allowed
2026-01-10 19:55:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/work-table-with-poly-top-36-inch-w-96-inch-l>: HTTP status code is not handled or not allowed
2026-01-10 19:55:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-w-x-30-d-x-12-h-stackbin-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:55:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10x15x2-expandable-ship-lite-envelopes>: HTTP status code is not handled or not allowed
2026-01-10 19:55:14 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/packaging/bags_covers/poly_bags_tubing_sheeting/reclosable_bags> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/packaging/bags_covers/poly_bags_tubing_sheeting/reclosable_bags landed on page that is not a product page.
2026-01-10 19:55:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10x13-flat-ship-lite-envelopes>: HTTP status code is not handled or not allowed
2026-01-10 19:55:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flagship-mobile-pedestal-file-cabinet-with-2-drawers-15w-x-22-78d-x-22h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:55:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/fasteners/door_window_hardware/insulation_film_weather_stripping>: HTTP status code is not handled or not allowed
2026-01-10 19:55:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-two-socket-cross-3>: HTTP status code is not handled or not allowed
2026-01-10 19:55:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5x8-2-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 19:55:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-syle-2-23-3-4-x-23-3-4-pvc-lay-in-tile-in-oil-rubbed-bronze-pl5226>: HTTP status code is not handled or not allowed
2026-01-10 19:55:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-medium-flange-5>: HTTP status code is not handled or not allowed
2026-01-10 19:55:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/28x17x110-1-mil-furniture-covers>: HTTP status code is not handled or not allowed
2026-01-10 19:55:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2321107-shelf-wire-22-inch-x26-1-2-inch-cp-for-kairak>: HTTP status code is not handled or not allowed
2026-01-10 19:55:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glass-door-freezer-1-door>: HTTP status code is not handled or not allowed
2026-01-10 19:55:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1331463-pad-filter-pwdr-175-inch-x28-inch-30-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:55:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-water-filter-pfas-3600-gallon-capacity-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:55:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-swivel-tee-2>: HTTP status code is not handled or not allowed
2026-01-10 19:55:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locbin-wall-storage-3-235yws-w-rails-large-yellow-8-pc>: HTTP status code is not handled or not allowed
2026-01-10 19:55:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/louvered-panel-lvp-1-24h-x-48w-blue-epoxy-1-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:55:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kee-klamp-flange-2>: HTTP status code is not handled or not allowed
2026-01-10 19:55:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10195094-harness-back-d-ring-tongue-buckle-leg-straps-super-extra-large>: HTTP status code is not handled or not allowed
2026-01-10 19:55:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-deluxe-series-worktop-refrigerator-48-long-2-door>: HTTP status code is not handled or not allowed
2026-01-10 19:55:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10195134-construction-harness-back-hip-d-rings-quick-connect-leg-straps-std>: HTTP status code is not handled or not allowed
2026-01-10 19:55:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coast-21531-model-fl75r-rechargeable-dual-color-530-lumen-headlamp-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:55:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-72in-w-x-36in-d-x-96in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:55:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x4x52-side-loading-boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:55:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-72in-w-x-36in-d-x-84in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:55:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/translucent-liner-30-x-72>: HTTP status code is not handled or not allowed
2026-01-10 19:55:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bristol-ridge-scraper-carpet-mat-4-ft-x-8-ft-cardinal>: HTTP status code is not handled or not allowed
2026-01-10 19:55:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/261247-worm-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 19:55:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comfort-rest-pebble-foam-mat-hd-2-ft-x-3-ft-coal>: HTTP status code is not handled or not allowed
2026-01-10 19:55:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-21-x-48-light-grey-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:55:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/armless-mesh-office-chair-fabric-black>: HTTP status code is not handled or not allowed
2026-01-10 19:55:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10195151-construction-harness-back-hip-d-rings-tongue-buckle-leg-straps-2xl>: HTTP status code is not handled or not allowed
2026-01-10 19:55:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48x12x6-long-corrugated-boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:55:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5581018-breaker-20a>: HTTP status code is not handled or not allowed
2026-01-10 19:55:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eb-double-bank-tool-cabinet-60-w-x-44-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:55:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/atlantic-olefin-entrance-carpet-mat-3-ft-x-6-ft-dark-toast>: HTTP status code is not handled or not allowed
2026-01-10 19:55:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10190398-standard-single-leg-adjustable-lanyard-6-36cl-lg-snaphooks-lt-weight-worker>: HTTP status code is not handled or not allowed
2026-01-10 19:55:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-wheel-rail-chock-with-handle>: HTTP status code is not handled or not allowed
2026-01-10 19:55:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-speed-strapping-machine>: HTTP status code is not handled or not allowed
2026-01-10 19:55:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-30-workmaster-bench-2>: HTTP status code is not handled or not allowed
2026-01-10 19:55:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-eye-rigging-hook-without-latch-10000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:55:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-eye-rigging-hook-without-latch-6000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:55:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-shelf-truck-36x24x69-1200-pound-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:55:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-shelf-truck-48x24x69-1200-pound-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:55:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-21-x-60-blue-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:55:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/packard-foot-mount-208-240va-output-40va>: HTTP status code is not handled or not allowed
2026-01-10 19:55:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ratchet-lever-hoist-3-ton-capacity-10-lift>: HTTP status code is not handled or not allowed
2026-01-10 19:55:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-plastic-chain-white>: HTTP status code is not handled or not allowed
2026-01-10 19:55:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tungsten-electrode-1-8-1-5-lanthinated-tungsten-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:55:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-72in-w-x-36in-d-x-96in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:55:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-shelf-heavy-duty-boltless-shelving-add-on-72in-w-x-15in-d-x-36in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:55:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-14-x-60-grey-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:55:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/32x18x8-corrugated-boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:55:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flipak-attached-lid-container-10>: HTTP status code is not handled or not allowed
2026-01-10 19:55:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-pro-100450-victor-style-cga-510-acetylene-regulator-450-series>: HTTP status code is not handled or not allowed
2026-01-10 19:55:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-96in-w-x-36in-d-x-60in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:55:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optional-dome-lid-rubbermaid-plastic-utility-truck-4>: HTTP status code is not handled or not allowed
2026-01-10 19:55:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/circuit-sensor-for-dual-cord-machines-with-1-wall-outlet-plug-1-twistlock-988cs>: HTTP status code is not handled or not allowed
2026-01-10 19:55:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012575-drive-chain-for-roundup-food-equipment>: HTTP status code is not handled or not allowed
2026-01-10 19:55:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1241307-evaporator-75-qt-20ga-stainless-steel-for-fisher-manufacturing>: HTTP status code is not handled or not allowed
2026-01-10 19:55:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t66842io-premium-wax-ribbon-80mm-x-450m-awr-8-12-rolls-case>: HTTP status code is not handled or not allowed
2026-01-10 19:55:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-14-x-72-light-grey-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:55:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dynamic-hydraulic-gear-pump-0-31-cu-in-rev-1-2-dia-straight-drive-shaft-6-71-gpm-5000-rpm>: HTTP status code is not handled or not allowed
2026-01-10 19:56:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edx-1t-edxtreme-dynamometer-with-backlight-shackles-2500-lb-x-2-5-lb>: HTTP status code is not handled or not allowed
2026-01-10 19:56:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-x2900-1-5-mil-poly-tubing>: HTTP status code is not handled or not allowed
2026-01-10 19:56:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-x10-x36-3-mil-gusseted-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 19:56:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-21-x-48-light-blue-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:56:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/120-x-30-extra-long-bench-shop-top-1>: HTTP status code is not handled or not allowed
2026-01-10 19:56:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-roller-lacer-1500-mm>: HTTP status code is not handled or not allowed
2026-01-10 19:56:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-heavy-duty-boltless-shelving-add-on-48in-w-x-48in-d-x-72in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:56:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-1-2x5-1-2-bilingual-packing-list-envelopes>: HTTP status code is not handled or not allowed
2026-01-10 19:56:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-x-2-80-full-pneumatic-caster-kit-2-swivel-2-rigid>: HTTP status code is not handled or not allowed
2026-01-10 19:56:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosure-kit-swing-door-18-x-18-x-18-black>: HTTP status code is not handled or not allowed
2026-01-10 19:56:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosure-kit-swing-door-18-x-18-x-18-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:56:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16605 pages (at 101 pages/min), scraped 6948 items (at 21 items/min)
2026-01-10 19:56:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-immersion-blender-2-speeds-1-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 19:56:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-72in-w-x-24in-d-x-72in-h-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:56:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv08b-lg09-8-cal-cm2-arc-flash-kit-w-fr-coverall-w-balaclava-lg-glove-size-09>: HTTP status code is not handled or not allowed
2026-01-10 19:56:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24x24x2-white-easy-fold-mailers>: HTTP status code is not handled or not allowed
2026-01-10 19:56:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silvers-19-oz-aluminized-pants-2xl-t45nl2xlx32>: HTTP status code is not handled or not allowed
2026-01-10 19:56:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silvers-19-oz-aluminized-chaps-osfm-l40nlnl40>: HTTP status code is not handled or not allowed
2026-01-10 19:56:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-12-triangular-sign-caution-slow-blind-corner>: HTTP status code is not handled or not allowed
2026-01-10 19:56:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8inch-flex-fillet-fishing-black-fibrox>: HTTP status code is not handled or not allowed
2026-01-10 19:56:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv11ng-md-12-cal-cm2-ultrasoft-arc-flash-kit-with-fr-coverall-md-no-gloves>: HTTP status code is not handled or not allowed
2026-01-10 19:56:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-20-round-sign-hearing-protection-required>: HTTP status code is not handled or not allowed
2026-01-10 19:56:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-00-rubber-voltage-gloves-black-size-8-dwh11008>: HTTP status code is not handled or not allowed
2026-01-10 19:56:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3x6-2-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 19:56:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-0-rubber-voltage-gloves-yellow-size-9-dwh1109y>: HTTP status code is not handled or not allowed
2026-01-10 19:56:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-14-x-72-blue-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:56:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-liners-30-x-36-dark-yellow-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:56:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/581001-steam-solenoid-valve3-4-inch-120v>: HTTP status code is not handled or not allowed
2026-01-10 19:56:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosure-kit-slide-door-18-x-36-x-13-light-grey>: HTTP status code is not handled or not allowed
2026-01-10 19:56:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosure-kit-slide-door-24-x-48-x-13-black>: HTTP status code is not handled or not allowed
2026-01-10 19:56:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-72inw-x-15ind-x-60inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelving_enclosure_kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:56:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slant-wire-shelving-5-shelves-48x18x54>: HTTP status code is not handled or not allowed
2026-01-10 19:56:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durastripe-20-round-sign-no-cell-phones-no-text>: HTTP status code is not handled or not allowed
2026-01-10 19:56:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caster-for-snap-loc-dolly-slac4sb-swivel-brake-4-casters>: HTTP status code is not handled or not allowed
2026-01-10 19:56:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a36a-repair-kit-45-closet>: HTTP status code is not handled or not allowed
2026-01-10 19:56:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-4-4-work-shirt-l-t-navy-blue-df2-cm-450c-ls-nb-lgt>: HTTP status code is not handled or not allowed
2026-01-10 19:56:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosure-kit-slide-door-24-x-48-x-13-light-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:56:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-60inw-x-24ind-x-96inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:56:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nonperforated-paper-towel-rolls-8x800ft-natural-12-carton>: HTTP status code is not handled or not allowed
2026-01-10 19:56:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit4sc402x08-40-cal-compliance-arc-flash-kit-w-short-coat-bib-overall-2xl-sz-08>: HTTP status code is not handled or not allowed
2026-01-10 19:56:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-2-rubber-voltage-glove-kit-black-size-9-kitgc209>: HTTP status code is not handled or not allowed
2026-01-10 19:56:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/56-1155-1-2-inch-fpt-union-x-1-2-inch-fpt-water-pressure-reducing-valve-10-to-35-lb-range>: HTTP status code is not handled or not allowed
2026-01-10 19:56:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-with-steel-decking-72x48x96-starter>: HTTP status code is not handled or not allowed
2026-01-10 19:56:34 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelving_enclosure_kits> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/storage/shelving/shelving_accessories/shelving_enclosure_kits landed on page that is not a product page.
2026-01-10 19:56:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-with-steel-decking-96x24x96-starter>: HTTP status code is not handled or not allowed
2026-01-10 19:56:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-high-capacity-bulk-rack-with-steel-decking-96x36x96-starter>: HTTP status code is not handled or not allowed
2026-01-10 19:56:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/46-1529-temperature-control-with-22-inch-capillary-185-to-365-f>: HTTP status code is not handled or not allowed
2026-01-10 19:56:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv11-lg10-12-cal-cm2-ultrasoft-arc-flash-kit-with-fr-coverall-lg-glove-size-10>: HTTP status code is not handled or not allowed
2026-01-10 19:56:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-base-6-inch-jaw-width-5-3-4-inch-jaw-opening-4-1-8-inch-throat-depth>: HTTP status code is not handled or not allowed
2026-01-10 19:56:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-pres-cntr-dbl-solenoid-vlv-pilot-spr-cntred-1-4-nptf-24v-dc-3w-coil-led-conn>: HTTP status code is not handled or not allowed
2026-01-10 19:56:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-3-awg-thhn-black-white-green-aluminum-mc>: HTTP status code is not handled or not allowed
2026-01-10 19:56:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/421906-rocker-switch-for-bevles>: HTTP status code is not handled or not allowed
2026-01-10 19:56:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wgr42-r-right-side-rack-protector-42>: HTTP status code is not handled or not allowed
2026-01-10 19:56:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-long-sleeve-t-shirt-xl-tan-c541ntnlsxl>: HTTP status code is not handled or not allowed
2026-01-10 19:56:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2561154-pad-touch-membrane-for-silver-king>: HTTP status code is not handled or not allowed
2026-01-10 19:56:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-42inw-x-30ind-x-72inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:56:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clam-shell-12v-utility-light-35-watts>: HTTP status code is not handled or not allowed
2026-01-10 19:56:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-heavy-duty-boltless-shelving-add-on-42inw-x-30ind-x-84inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:56:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/31-deluxe-triple-brush-push-power-sweeper>: HTTP status code is not handled or not allowed
2026-01-10 19:56:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metromax-4-30-w-x-24-d-x-54-h-mobile-unit>: HTTP status code is not handled or not allowed
2026-01-10 19:56:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-round-stainless-steel-light-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 19:56:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-powered-c-clamp-mount-agitator-1-hp-2-5-inch-propellers>: HTTP status code is not handled or not allowed
2026-01-10 19:56:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd-ball-mount-10k>: HTTP status code is not handled or not allowed
2026-01-10 19:56:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m8064-12-tubing-clamp-10pkg>: HTTP status code is not handled or not allowed
2026-01-10 19:56:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-shelving-open-shelving-14>: HTTP status code is not handled or not allowed
2026-01-10 19:56:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k93218-filter-regulator-1-in-npt>: HTTP status code is not handled or not allowed
2026-01-10 19:56:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-round-1-led-red-marker-light-w-grommet-plug>: HTTP status code is not handled or not allowed
2026-01-10 19:56:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/461033-thermostat-w-dialsp-3-16-x-12-1-4-60-for-nemco>: HTTP status code is not handled or not allowed
2026-01-10 19:56:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/circuit-1-receptacle-package-of-4>: HTTP status code is not handled or not allowed
2026-01-10 19:56:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv112x08-12-cal-cm2-ultrasoft-arc-flash-kit-with-fr-coverall-2xl-glove-size-08>: HTTP status code is not handled or not allowed
2026-01-10 19:56:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motorized-digital-bottletop-burette-731301059999-45mm-thread-0-01-99-99-ml>: HTTP status code is not handled or not allowed
2026-01-10 19:56:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/big-tall-stool-with-adjustable-t-arms-black>: HTTP status code is not handled or not allowed
2026-01-10 19:56:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b5-flat-clinch-executive-stapler-black>: HTTP status code is not handled or not allowed
2026-01-10 19:56:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23-20-super-premium-heavy-duty-staples-20-mm-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:56:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-compartment-wood-literature-sorter-34-1-2-h-oak>: HTTP status code is not handled or not allowed
2026-01-10 19:56:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-48inw-x-12ind-x-84inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:56:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-closed-single-solenoid-valve-ext-pilot-g-1-8-24v-ac-5va-coil-black-connection>: HTTP status code is not handled or not allowed
2026-01-10 19:56:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/32x32x32-corrugated-boxes>: HTTP status code is not handled or not allowed
2026-01-10 19:57:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-in-w-x-46-in-h-panel-with-electric-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:57:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-x-3-x-30-160-edge-protectors-cased>: HTTP status code is not handled or not allowed
2026-01-10 19:57:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-24-x-1-2-phillips-flat-head-machine-screw-pkg-of-100-dwa03016>: HTTP status code is not handled or not allowed
2026-01-10 19:57:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/481177-hi-limit>: HTTP status code is not handled or not allowed
2026-01-10 19:57:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drum-bung-wrench-dw50-glass-reinforced-nylon>: HTTP status code is not handled or not allowed
2026-01-10 19:57:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv08ng-lg-8-cal-cm2-arc-flash-kit-with-fr-coverall-lg-no-gloves>: HTTP status code is not handled or not allowed
2026-01-10 19:57:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-pressure-cntr-g1-8-dbl-solenoid-valve-pilot-spr-cntred-24v-ac-5va-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 19:57:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-72inw-x-48ind-x-96inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dewalt-compressors-d55146>: HTTP status code is not handled or not allowed
2026-01-10 19:57:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv08-lg12-8-cal-cm2-arc-flash-kit-with-fr-coverall-lg-glove-size-12>: HTTP status code is not handled or not allowed
2026-01-10 19:57:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kit2cv08-lg11-8-cal-cm2-arc-flash-kit-with-fr-coverall-lg-glove-size-11>: HTTP status code is not handled or not allowed
2026-01-10 19:57:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-hose-double-male-hose-nipple-358-1061021-1-npt-x-1-nh-brass>: HTTP status code is not handled or not allowed
2026-01-10 19:57:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16705 pages (at 100 pages/min), scraped 6971 items (at 23 items/min)
2026-01-10 19:57:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/structural-plastic-shelving-36x16x72-adjustable>: HTTP status code is not handled or not allowed
2026-01-10 19:57:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combination-toggle-bolt-5-16-18-x-4-slotted-round-head-steel-zinc-pkg-of-50-893088>: HTTP status code is not handled or not allowed
2026-01-10 19:57:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drop-in-anchor-w-setting-tool-5-8-steel-zinc-pkg-of-25-268040>: HTTP status code is not handled or not allowed
2026-01-10 19:57:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-x-5-x-2-corrugated-mailers>: HTTP status code is not handled or not allowed
2026-01-10 19:57:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/angle-hose-valve-170-2521-2-1-2-nh-brass>: HTTP status code is not handled or not allowed
2026-01-10 19:57:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-x-9-x-2-literature-mailers>: HTTP status code is not handled or not allowed
2026-01-10 19:57:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-stacking-bin-16-1-2-x-18-x-11-beige>: HTTP status code is not handled or not allowed
2026-01-10 19:57:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-starter-72inw-x-36ind-x-96inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-72inw-x-48ind-x-72inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/popcorn-jumbo-bags-5-25x12>: HTTP status code is not handled or not allowed
2026-01-10 19:57:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-starter-96inw-x-24ind-x-72inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hotdog-roller-grills-30-dogs>: HTTP status code is not handled or not allowed
2026-01-10 19:57:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-96inw-x-48ind-x-60inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-hose-adapter-363-2521561-2-1-2-nh-x-1-1-2-npt-brass>: HTTP status code is not handled or not allowed
2026-01-10 19:57:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010945-retainer-upperwheel-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 19:57:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-sign-cotton-candy>: HTTP status code is not handled or not allowed
2026-01-10 19:57:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-dbl-solenoid-vlv-ext-pilot-pres-cntr-spr-cntred-1-4-npt-110v-ac-5va-coil-blk>: HTTP status code is not handled or not allowed
2026-01-10 19:57:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-dbl-solenoid-vlv-ext-pilot-closed-cntr-spr-cntred-g1-8-12v-dc-3w-coil-black>: HTTP status code is not handled or not allowed
2026-01-10 19:57:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/282280-dial-assembly-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 19:57:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-truck-nexelon-c-o-26>: HTTP status code is not handled or not allowed
2026-01-10 19:57:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gardner-bender-automotive-circuit-tester-12-vdc>: HTTP status code is not handled or not allowed
2026-01-10 19:57:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-16w-5-step-steel-rolling-ladder-14d-top-step-wcal-osha-handrail-ca>: HTTP status code is not handled or not allowed
2026-01-10 19:57:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gardner-bender-outlet-tester-120-vac>: HTTP status code is not handled or not allowed
2026-01-10 19:57:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-work-shirt-m-tan-tcg01120216>: HTTP status code is not handled or not allowed
2026-01-10 19:57:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drainable-blade-fixed-louver-with-flange-60w-x-60h-dfl-f-60x60>: HTTP status code is not handled or not allowed
2026-01-10 19:57:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-60inw-x-48ind-x-60inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvaneal-modular-fixed-louver-36w-x-24h-gfl-36x24>: HTTP status code is not handled or not allowed
2026-01-10 19:57:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012061-hood-fitting-orifice-56-for-southbend-range>: HTTP status code is not handled or not allowed
2026-01-10 19:57:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-58-enclosed-blower-115v-1135rpm-14hp>: HTTP status code is not handled or not allowed
2026-01-10 19:57:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-heavy-duty-boltless-shelving-starter-36inw-x-18ind-x-96inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010040-release-sheet-clip-fornew-grill-for-taylor-freezer>: HTTP status code is not handled or not allowed
2026-01-10 19:57:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/co2-adsorber-sterile-filter-0-2m-1-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:57:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/direct-replacement-york-115v-1075rpm-1hp>: HTTP status code is not handled or not allowed
2026-01-10 19:57:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-starter-72inw-x-48ind-x-96inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-s-brass-centerset-lavatory-with-pop-up>: HTTP status code is not handled or not allowed
2026-01-10 19:57:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/265890-ret-ring-knife-shaft-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 19:57:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-anti-theft-ring-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 19:57:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freshen-aire-scented-mini-air-mover-with-ionizer-1-8-hp-3-speeds-4-positions-p-150n>: HTTP status code is not handled or not allowed
2026-01-10 19:57:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-heavy-duty-boltless-shelving-starter-48inw-x-18ind-x-96inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carrier-replacement-1140rpm-460v-34hp>: HTTP status code is not handled or not allowed
2026-01-10 19:57:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-work-shirt-s-gray-tcg01150213>: HTTP status code is not handled or not allowed
2026-01-10 19:57:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/workhorse-dispensing-pump-for-1-gallon-containers-w-convertible-51-din-connector>: HTTP status code is not handled or not allowed
2026-01-10 19:57:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4c-horizontal-mailbox-n1029416-56-1-2h-single-column-9-doors-1-parcel-usps>: HTTP status code is not handled or not allowed
2026-01-10 19:57:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-work-shirt-m-ln-light-blue-tcg01190217>: HTTP status code is not handled or not allowed
2026-01-10 19:57:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1331503-lid-milk-dispenser-2-qt-for-carlisle-foodservice-products>: HTTP status code is not handled or not allowed
2026-01-10 19:57:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vac-sealer-maintenance-kit-pro-2100-2300-3000>: HTTP status code is not handled or not allowed
2026-01-10 19:57:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xerox-bold-digital-carbonless-paper-xer3r12435-8-1-2-11-white-500-sheets>: HTTP status code is not handled or not allowed
2026-01-10 19:57:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-open-1-8-nptf-single-solenoid-valve-pilot-spr-return-110v-ac-5va-coil-led-conn>: HTTP status code is not handled or not allowed
2026-01-10 19:57:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/29-kevlar-twill-shoulder-cape-sleeve-yellow-s30kv29>: HTTP status code is not handled or not allowed
2026-01-10 19:57:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-capacity-33-lbs-cylinders-heavy-duty-steel-gas-cylinder-cage-44w-x-30d-x-70h-white>: HTTP status code is not handled or not allowed
2026-01-10 19:57:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-58-stock-115v-1075rpm-14hp>: HTTP status code is not handled or not allowed
2026-01-10 19:57:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-heavy-duty-boltless-shelving-starter-96inw-x-36ind-x-72inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strongknit-hi-vis-long-sleeve-fr-t-shirt-type-r-class-3-2xl-t-yellow>: HTTP status code is not handled or not allowed
2026-01-10 19:57:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-locker-accessory-closed-side-base-15d-x-6h-725-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:57:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-58-indoor-blower-208-230v-1075rpm-14hp>: HTTP status code is not handled or not allowed
2026-01-10 19:57:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyester-web-sling-hd-single-ply-endless-with-durable-edge-6-ft-l>: HTTP status code is not handled or not allowed
2026-01-10 19:57:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-open-cntr-g1-8-dbl-solenoid-valve-pilot-spring-cntred-110v-ac-5va-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 19:57:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/direct-replacement-first-cosummit-208-230v-1500rpm-18hp>: HTTP status code is not handled or not allowed
2026-01-10 19:57:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slotted-pegboard-hook-kit-white>: HTTP status code is not handled or not allowed
2026-01-10 19:57:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-welded-storage-cabinet-36w-x-24d-x-60h-sand>: HTTP status code is not handled or not allowed
2026-01-10 19:57:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-welded-deluxe-storage-cabinet36w-x-24d-x-78-3-4-h-light-grey>: HTTP status code is not handled or not allowed
2026-01-10 19:57:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-72inw-x-24ind-x-60inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:57:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-thru-deluxe-unassembled-steel-wardrobe-cabinet-36w-x-18d-x-78h-sand>: HTTP status code is not handled or not allowed
2026-01-10 19:58:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-steel-table-2-shelves-48x30-1200-lb-capacity-unassembled-2>: HTTP status code is not handled or not allowed
2026-01-10 19:58:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/direct-drive-blower-1075rpm-115v-13hp>: HTTP status code is not handled or not allowed
2026-01-10 19:58:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-utility-shirt-s-tan-df2-324ls-kh-sm>: HTTP status code is not handled or not allowed
2026-01-10 19:58:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-add-on-72inw-x-48ind-x-96inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:58:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-2-double-solenoid-valve-pilot-1-4-nptf-24v-dc-2w-coil-black-connection>: HTTP status code is not handled or not allowed
2026-01-10 19:58:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergonomic-shell-chair-right-handed-tablet-arm-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:58:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010874-magnet-for-champion-dishwasher>: HTTP status code is not handled or not allowed
2026-01-10 19:58:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contemporary-leather-sofa-black-hercules-definity-series>: HTTP status code is not handled or not allowed
2026-01-10 19:58:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contemporary-leather-loveseat-black-hercules-definity-series>: HTTP status code is not handled or not allowed
2026-01-10 19:58:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergonomic-shell-chair-right-handed-tablet-arm-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:58:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-thru-standard-welded-steel-wardrobe-cabinet-wardrobe-cabinet-36w-x-18d-x-72h-black>: HTTP status code is not handled or not allowed
2026-01-10 19:58:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-2-single-solenoid-valve-ext-pilot-spr-return-1-8-nptf-110v-ac-5va-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 19:58:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16806 pages (at 101 pages/min), scraped 6997 items (at 26 items/min)
2026-01-10 19:58:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-heavy-duty-boltless-shelving-starter-96inw-x-48ind-x-96inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:58:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/five-tier-box-locker-with-legs-3-wide-12w-x-18d-x-12h-assembled-medium-grey>: HTTP status code is not handled or not allowed
2026-01-10 19:58:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quick-adjust-shelf-36x18-with-4-hooks>: HTTP status code is not handled or not allowed
2026-01-10 19:58:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cross-linked-polyethylene-foam-sheet-no-adhesive-1-2-x-12-x-12>: HTTP status code is not handled or not allowed
2026-01-10 19:58:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-16-x-2-1-2-security-machine-screw-flat-hex-socket-head-alloy-steel-black-oxide-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:58:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/label-holders-175-in-2-5-8-in-clear-full-self-adhering>: HTTP status code is not handled or not allowed
2026-01-10 19:58:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-2-double-solenoid-valve-ext-pilot-g-1-8-220v-ac-5va-coil-black-connection>: HTTP status code is not handled or not allowed
2026-01-10 19:58:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-60inw-x-36ind-x-72inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:58:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-18-x-2-security-machine-screw-flat-hex-socket-head-alloy-steel-black-oxide-ft-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:58:17 [py.warnings] (PID: 62) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2026-01-10 19:58:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2561091-cover-bottom-freezer-lexan-for-silver-king>: HTTP status code is not handled or not allowed
2026-01-10 19:58:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-heavy-duty-boltless-shelving-add-on-72inw-x-36ind-x-60inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:58:17 [scrapy.extensions.feedexport] (PID: 62) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:7
2026-01-10 19:58:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2561152-jaw-valve-2-inch-l-for-silver-king>: HTTP status code is not handled or not allowed
2026-01-10 19:58:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-strip-curtain-door-bulk-roll-standard-grade-clear-8-x-300-x-080>: HTTP status code is not handled or not allowed
2026-01-10 19:58:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inertia-womens-safety-work-boots-steel-toe-7h-size-105-matte-black>: HTTP status code is not handled or not allowed
2026-01-10 19:58:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spice-womens-safety-work-boots-steel-toe-7h-size-7w-auburn>: HTTP status code is not handled or not allowed
2026-01-10 19:58:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/culinary-basket-10-dia-3-deep-fine-mesh>: HTTP status code is not handled or not allowed
2026-01-10 19:58:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hardwood-dolly-with-carpeted-ends-deck-30-x-18-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:58:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-32-x-2-security-machine-screw-button-hex-socket-head-alloy-steel-black-oxide-ft-100-pk-21210>: HTTP status code is not handled or not allowed
2026-01-10 19:58:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nvt2201-portable-balance-2-200g-x-0-1g-6-15-16-x-9-1-8-platform>: HTTP status code is not handled or not allowed
2026-01-10 19:58:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/easy-adjust-boltless-shelf-truck-with-wood-shelves-10>: HTTP status code is not handled or not allowed
2026-01-10 19:58:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-open-cntr-g1-4-dbl-solenoid-valve-pilot-spring-cntred-110v-ac-5va-coil-black-conn>: HTTP status code is not handled or not allowed
2026-01-10 19:58:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011049-limit-base-bracket-for-henny-penny>: HTTP status code is not handled or not allowed
2026-01-10 19:58:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/easy-adjust-boltless-shelf-truck-with-wood-shelves-14>: HTTP status code is not handled or not allowed
2026-01-10 19:58:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/printable-magnetic-sheet-laser-letter-size>: HTTP status code is not handled or not allowed
2026-01-10 19:58:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-king-sk3000-pallet-rack-120w-x-36d-x-144h-3320-lbs-cap-per-level-add-on-unit>: HTTP status code is not handled or not allowed
2026-01-10 19:58:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12ab-x-1-security-sheet-metal-screw-button-torx-head-302hq-stainless-steel-ft-usa-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:58:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-king-sk3000-pallet-rack-96w-x-36d-x-144h-4900-lbs-cap-per-level-add-on-unit>: HTTP status code is not handled or not allowed
2026-01-10 19:58:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-187-ballerina-5-light-chandelier-alabaster-bell-textured-white-24w-x-18h>: HTTP status code is not handled or not allowed
2026-01-10 19:58:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-king-sk3000-pallet-rack-72w-x-36d-x-96h-5960-lbs-cap-per-level-starter-unit>: HTTP status code is not handled or not allowed
2026-01-10 19:58:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-king-sk3000-pallet-rack-108w-x-48d-x-144h-4040-lbs-cap-per-level-add-on-unit>: HTTP status code is not handled or not allowed
2026-01-10 19:58:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72w-x-30d-x-30h-anti-static-laminate-workbench-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:58:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-king-sk3000-pallet-rack-120w-x-48d-x-120h-3320-lbs-cap-per-level-add-on-unit>: HTTP status code is not handled or not allowed
2026-01-10 19:58:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8ab-x-1-2-security-sheet-metal-screw-button-torx-head-302hq-stainless-steel-usa-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:58:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dagr-safety-glasses-matte-black-clear-lens-52400>: HTTP status code is not handled or not allowed
2026-01-10 19:58:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nova-eh-20-womens-safety-work-boots-steel-toe-18h-size-8-black>: HTTP status code is not handled or not allowed
2026-01-10 19:58:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-single-union-ball-valve>: HTTP status code is not handled or not allowed
2026-01-10 19:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/transformers_uninterrupted_power_supplies/uninterrupted_power_supply_backup_systems already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:58:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omega-womens-safety-work-boots-steel-toe-6h-size-11-black>: HTTP status code is not handled or not allowed
2026-01-10 19:58:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-8-step-aluminum-folding-step-ladder-330-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:58:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-290-ballerina-7-light-vanity-wall-alabaster-polished-chrome-48w-x-7-625h>: HTTP status code is not handled or not allowed
2026-01-10 19:58:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8000va-smart-online-ups-w-hot-swappable-pdu-208-240v-6-outlets>: HTTP status code is not handled or not allowed
2026-01-10 19:58:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010921-wiper-assembly-upper-wheel-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 19:58:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-c-polypropylene-cam-and-groove-coupler-x-hose-shank>: HTTP status code is not handled or not allowed
2026-01-10 19:58:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-edge-work-bench-top-plastic-60-w-x-30-d-x-1-5-8-thick>: HTTP status code is not handled or not allowed
2026-01-10 19:58:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-32-x-1-1-2-security-machine-screw-button-hex-socket-head-302hq-18-8-ss-ft-unc-100-pk-22040>: HTTP status code is not handled or not allowed
2026-01-10 19:58:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/76-668-2-light-mounting-plate-antique-verdi-4-5w-x-1h>: HTTP status code is not handled or not allowed
2026-01-10 19:58:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-24-x-1-2-security-machine-screw-button-torx-plus-head-18-8-stainless-steel-ft-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 19:58:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omega-womens-safety-work-boots-steel-toe-6h-size-85-black>: HTTP status code is not handled or not allowed
2026-01-10 19:58:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wide-span-rack-96x24x96-with-3-shelves-wood-deck-1100-lb-capacity-per-level>: HTTP status code is not handled or not allowed
2026-01-10 19:58:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omega-womens-safety-work-boots-steel-toe-6h-size-85w-bourbon-brown>: HTTP status code is not handled or not allowed
2026-01-10 19:58:50 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/transformers_uninterrupted_power_supplies/uninterrupted_power_supply_backup_systems> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/transformers_uninterrupted_power_supplies/uninterrupted_power_supply_backup_systems landed on page that is not a product page.
2026-01-10 19:58:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-18-x-2-security-machine-screw-button-torx-head-302hq-stainless-steel-ft-unc-100-pk-75030>: HTTP status code is not handled or not allowed
2026-01-10 19:58:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-16-x-1-security-machine-screw-button-torx-head-302hq-stainless-steel-ft-unc-100-pk-75410>: HTTP status code is not handled or not allowed
2026-01-10 19:58:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spice-womens-safety-work-boots-steel-toe-7h-size-85-auburn>: HTTP status code is not handled or not allowed
2026-01-10 19:58:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2631023-curtain-dishwasher-225x-205-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 19:58:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-sink-2-station-with-electronic-faucets-rountube-mounte4x20-xd>: HTTP status code is not handled or not allowed
2026-01-10 19:58:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/281928-insulation-flue-front-for-frymaster>: HTTP status code is not handled or not allowed
2026-01-10 19:58:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-edge-work-bench-top-shop-top-60-w-x-30-d-x-2-1-4-thick>: HTTP status code is not handled or not allowed
2026-01-10 19:58:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/54-032-hickory-handle-ball-pein-hammer-32-oz>: HTTP status code is not handled or not allowed
2026-01-10 19:58:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/badger-neoprene-boots-steel-toe-upper-rubber-sole-steel-shank-15-h-blk-size-10>: HTTP status code is not handled or not allowed
2026-01-10 19:58:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/signs-with-safety-message-legend-danger-flammable-material-no-4>: HTTP status code is not handled or not allowed
2026-01-10 19:58:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/badger-neoprene-boots-steel-toe-upper-rubber-sole-steel-shank-15-h-blk-size-6>: HTTP status code is not handled or not allowed
2026-01-10 19:59:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jumbo-display-wall-clock-calendar>: HTTP status code is not handled or not allowed
2026-01-10 19:59:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-t-shirt-long-sleeve-1-pocket-fl-lime-small>: HTTP status code is not handled or not allowed
2026-01-10 19:59:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/horizon-womens-safety-work-boots-alloy-toe-8h-size-85-desert-tan>: HTTP status code is not handled or not allowed
2026-01-10 19:59:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aware-wear-ansi-class-3-hooded-pull-over-sweatshirt-61540-lime>: HTTP status code is not handled or not allowed
2026-01-10 19:59:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/511091-cage-unit-for-market-forge>: HTTP status code is not handled or not allowed
2026-01-10 19:59:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010940-cover-wheel-rear-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 19:59:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/76-678-2-light-ceiling-flush-mount-large-alabaster-mushroom-polished-brass-12w-x-6h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/additional-shelf-level-boltless-wood-deck-12>: HTTP status code is not handled or not allowed
2026-01-10 19:59:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-222-2-light-ceiling-flush-mount-alabaster-textured-white-13-125w-x-5-375h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glc-01228-32oz-clear-boston-round-bottle-with-33-400-black-phenolic-cap-case-of-12>: HTTP status code is not handled or not allowed
2026-01-10 19:59:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-lock-hitch-attachment-for-rough-terrain-electric-powered-pallet-jack-trucks>: HTTP status code is not handled or not allowed
2026-01-10 19:59:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16900 pages (at 94 pages/min), scraped 7018 items (at 21 items/min)
2026-01-10 19:59:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/76-132-2-light-ceiling-flush-mount-frosted-ribbed-polished-brass-13-25w-x-5-5h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-stem-caster-4-dia-nomadic-derlin-bearing-with-2-h-stem>: HTTP status code is not handled or not allowed
2026-01-10 19:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/flush_mount_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:59:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-stem-caster-5-dia-phenolic-bore-with-1-3-8-h-stem>: HTTP status code is not handled or not allowed
2026-01-10 19:59:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-1826-dupont-2-light-ceiling-flush-mount-satin-white-brushed-nickel-15w-x-7-75h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deep-cleaning-ribbed-mat-4x8-charcoal-1>: HTTP status code is not handled or not allowed
2026-01-10 19:59:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paulson-a-tac-wildland-firefighter-goggles-nose-shield-silicone-strap-polycarbonate-lens>: HTTP status code is not handled or not allowed
2026-01-10 19:59:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deep-cleaning-ribbed-mat-3x10-red-1>: HTTP status code is not handled or not allowed
2026-01-10 19:59:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lux-ssetpbk-ol-class-2-black-bottom-t-shirt-w-pocket-orange-l>: HTTP status code is not handled or not allowed
2026-01-10 19:59:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-206-2-light-ceiling-flush-mount-alabaster-glass-old-bronze-13-125w-x-5-375h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-elevated-wooden-chicken-coop-with-ramp-nesting-box-wire-mesh-run-waterproof-roof>: HTTP status code is not handled or not allowed
2026-01-10 19:59:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009938-saniserve-stator-rod>: HTTP status code is not handled or not allowed
2026-01-10 19:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/flush_mount_lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 19:59:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/science-lab-table-30h-with-black-phenolic-resin-top-60-30>: HTTP status code is not handled or not allowed
2026-01-10 19:59:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8407901-control-board-j>: HTTP status code is not handled or not allowed
2026-01-10 19:59:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-x-30-18-gauge-stainless-steel-workbench>: HTTP status code is not handled or not allowed
2026-01-10 19:59:21 [scrapy.core.scraper] (PID: 62) ERROR: Spider error processing <GET https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/flush_mount_lights> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 346, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 394, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 375, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/asyncgen.py", line 21, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 384, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 62, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 60, in process_spider_output_async
    async for r in result:
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 121, in process_async
    async for r in iterable:
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/__init__.py", line 160, in parse_product
    yield await page.to_item()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 81, in _to_item
    validation_item = self._validate_input()
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/utils.py", line 205, in inner
    return cached_meth(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/web_poet/pages.py", line 140, in _validate_input
    validation_item = self.validate_input()  # type: ignore[attr-defined]
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/pages/__init__.py", line 33, in validate_input
    raise NotProductPage(f"URL {self.url} landed on page that is not a product page.")
scraping_utils.common.exceptions.NotProductPage: URL https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/flush_mount_lights landed on page that is not a product page.
2026-01-10 19:59:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/letter-depth-hanging-folder-drawer-non-locking-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 19:59:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-high-letter-adder-empty-black>: HTTP status code is not handled or not allowed
2026-01-10 19:59:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foam-nitrile-palm-coated-nylon-gloves-posigrip-713snfl>: HTTP status code is not handled or not allowed
2026-01-10 19:59:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-1252-ballerina-3-light-chandelier-champagne-washed-linen-mahogany-bronze-20w-x-17h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-x-6-portable-wire-grid-wall-panel-chrome>: HTTP status code is not handled or not allowed
2026-01-10 19:59:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hss-tmx-adjustable-blade-reamer-j-1-3-16-inch-to-1-11-32-inch-diameter-range-11-inch-oal>: HTTP status code is not handled or not allowed
2026-01-10 19:59:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-high-legal-starter-empty-black>: HTTP status code is not handled or not allowed
2026-01-10 19:59:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-gauge-36-w-x-36-d-x-86-h-5-shelf-corrugate-rack-100-lb-shelf-capacity-blue>: HTTP status code is not handled or not allowed
2026-01-10 19:59:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/letter-file-storage-drawer-locking-black>: HTTP status code is not handled or not allowed
2026-01-10 19:59:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/indoor_lighting_fixtures/decorative_lighting/flush_mount_lights>: HTTP status code is not handled or not allowed
2026-01-10 19:59:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-air-5-hp-80-gallon-two-stage-single-phase-stationary-air-compressor>: HTTP status code is not handled or not allowed
2026-01-10 19:59:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adder-unit-legal-31-inch-38-3-4-inch-92-1-2-inch-8-opening-black>: HTTP status code is not handled or not allowed
2026-01-10 19:59:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1381197-holder-thermometer-wall-mt>: HTTP status code is not handled or not allowed
2026-01-10 19:59:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-boltless-shelving-starter-36inw-x-24ind-x-96inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:59:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-bollard-with-galvanized-steel-cap-wg-24>: HTTP status code is not handled or not allowed
2026-01-10 19:59:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62-1088-2-inch-solar-powered-digital-thermometer-with-120-inch-capillary>: HTTP status code is not handled or not allowed
2026-01-10 19:59:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-24-w-11-step-steel-rolling-ladder-14-d-top-step>: HTTP status code is not handled or not allowed
2026-01-10 19:59:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hss-tmx-hand-reamer-straight-flute-straight-shank-1-1-4-inch-diameter-12-flutes>: HTTP status code is not handled or not allowed
2026-01-10 19:59:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pneumatic-adjustable-round-pedestal-table-white>: HTTP status code is not handled or not allowed
2026-01-10 19:59:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011614-switch-kit>: HTTP status code is not handled or not allowed
2026-01-10 19:59:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-x-3-8-poly-barb-hose-splicer-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:59:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-flow-brass-6-ball-1-4-x-1-4-female-coupler-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 19:59:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-3277-empire-4-light-vanity-wall-frosted-white-brushed-nickel-28-75w-x-6-125h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylinder-tube-rack-2-wide-x-2-deep-30-w-x-26-d-x-30-h-4-cylinder-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:59:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-rubber-load-bearing-pad-6-long-6-wide-1h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-3283-ballerina-7-light-vanity-wall-frosted-white-brushed-nickel-48w-x-7-625h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-mid-back-fabric-stool-with-aluminum-base-foot-ring-navy>: HTTP status code is not handled or not allowed
2026-01-10 19:59:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-24-w-15-step-steel-rolling-ladder-21-d-top-step>: HTTP status code is not handled or not allowed
2026-01-10 19:59:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-boltless-shelving-starter-48inw-x-24ind-x-84inh-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:59:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-ratio-led-floodlight-30000l-265w-40k-wide-dist-knuckle-mt-120-277v>: HTTP status code is not handled or not allowed
2026-01-10 19:59:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-5132-patton-2-light-vanity-wall-frosted-prairie-bronze-15w-x-10h>: HTTP status code is not handled or not allowed
2026-01-10 19:59:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-50-ft-1000-psi-without-hose-hand-crank>: HTTP status code is not handled or not allowed
2026-01-10 19:59:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-ratio-dusk-to-dawn-led-floodlight-4800l-34w-50k-wide-dist-knuckle-mt-120-277v>: HTTP status code is not handled or not allowed
2026-01-10 19:59:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-step-24-w-perforated-all-directional-steel-ladder>: HTTP status code is not handled or not allowed
2026-01-10 19:59:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2000-series-safe-t-alert-back-up-alarm-102db-12-24-volts-wire-leads>: HTTP status code is not handled or not allowed
2026-01-10 19:59:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cyclone-hand-chain-hoist-on-geared-trolley-1-ton-10-ft-lift>: HTTP status code is not handled or not allowed
2026-01-10 19:59:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-awg-3-cond-45-ft-20-amp-flying-leads>: HTTP status code is not handled or not allowed
2026-01-10 19:59:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lester-series-36v-115vac-60hz-portable-charger-40-amps>: HTTP status code is not handled or not allowed
2026-01-10 19:59:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-5-step-24-wx36-l-platform-w-handrails>: HTTP status code is not handled or not allowed
2026-01-10 19:59:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n22-32-series-rigid-caster-n32-5-mc-phenolic-5-dia-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:59:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-cantilever-heavy-duty-shelf-18-wx36-l>: HTTP status code is not handled or not allowed
2026-01-10 19:59:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2271190-timer-upgrade-kit-for-henny-penny>: HTTP status code is not handled or not allowed
2026-01-10 19:59:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-23-33-medium-duty-swivel-caster-23-4-irb-semi-steel-4-dia-600-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:59:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-mold-on-wheel-e-825-rc-5-dia-2w-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 19:59:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-boltless-shelving-starter-36inw-x-12ind-x-96inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 19:59:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-steel-bound-platform-truck-e-lq-2448-6poe-24-x-48-6-wheels-2500-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 19:59:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009796-hp-triangular-filter-bar-for-henny-penny>: HTTP status code is not handled or not allowed
2026-01-10 19:59:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/configurable-multi-platform-access-system-1-step-18-h-45-deg-stairway-ladder-mpassw2>: HTTP status code is not handled or not allowed
2026-01-10 19:59:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009801-door-llt-hand-ofe-ofg323-24-inch-x-10-3-4-inch-for-henny-penny>: HTTP status code is not handled or not allowed
2026-01-10 20:00:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-boltless-shelving-starter-36inw-x-12ind-x-96inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:00:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inside-stational-deck-dome-oven-square-exterior-51-gas-92500-btu-120v-digital-control>: HTTP status code is not handled or not allowed
2026-01-10 20:00:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-conductor-grounded-arctic-tropic-yellow-cord-300v-4>: HTTP status code is not handled or not allowed
2026-01-10 20:00:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m12-cordless-compact-lithium-ion-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:00:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-series-lever-dolly-e-60-rt-boxed-60-handle-mold-on-rubber-wheels-3500-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:00:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-economy-lift-beam-fixed-length-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:00:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/Industrial-plastic-gray-2-shelf-service-utility-38x17-5-cart-Ladder-and-utility-hooks>: HTTP status code is not handled or not allowed
2026-01-10 20:00:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6ft-aluminum-team-bench-with-rear-shelf-backrest-portable>: HTTP status code is not handled or not allowed
2026-01-10 20:00:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-emergency-exit-combo-with-self-diagnostics-white-with-red-letters-120-277v>: HTTP status code is not handled or not allowed
2026-01-10 20:00:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-boltless-shelving-add-on-48inw-x-18ind-x-72inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:00:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6ft-aluminum-team-bench-with-back-galvanized-frame-surface-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:00:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tilt-master-12v-dc-pallet-container-tilter-4000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:00:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-boltless-shelving-add-on-36inw-x-12ind-x-96inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:00:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 16997 pages (at 97 pages/min), scraped 7039 items (at 21 items/min)
2026-01-10 20:00:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-boltless-shelving-add-on-48inw-x-12ind-x-96inh-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 62) WARNING: Request https://www.globalindustrial.com/c/electrical/outdoor_lighting_fixtures/landscape_lighting already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-10 20:00:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lnc-7lu-5k-3-1-compact-led-wallpak-bronze-1500l-17w-5000k-type-iii-dist-0-10v-dim>: HTTP status code is not handled or not allowed
2026-01-10 20:00:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safe-rotary-hopper-drop-safe-14-w-x-17-d-x-21-h-dual-key-lock-black>: HTTP status code is not handled or not allowed
2026-01-10 20:00:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-underbody-tuck-box-14-12-16-silver1705148>: HTTP status code is not handled or not allowed
2026-01-10 20:00:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premier-refrigerator-and-freezer-combo-9-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:00:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-rectangular-outdoor-table-expanded-metal-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:00:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/516-style-a-j-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:00:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100-br38-y-230v-100w-incandescent-w-european-medium-base>: HTTP status code is not handled or not allowed
2026-01-10 20:00:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mounting-bracket-for-1-2-3-gallon-sharps-containers>: HTTP status code is not handled or not allowed
2026-01-10 20:00:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-3-shelf-boltless-shelving-add-on-36inw-x-18ind-x-48inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:00:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35t4-cl-35w-halogen-w-bi-pin-base-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:00:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-3-shelf-boltless-shelving-add-on-48inw-x-24ind-x-48inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:00:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/telescoping-forklift-jib-lift-crane-jlt411-4000-lb-capacity-11-on-center-fork-pockets>: HTTP status code is not handled or not allowed
2026-01-10 20:00:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/c/electrical/outdoor_lighting_fixtures/landscape_lighting>: HTTP status code is not handled or not allowed
2026-01-10 20:00:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-3-shelf-boltless-shelving-add-on-48inw-x-24ind-x-72inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:00:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/telescoping-forklift-jib-lift-crane-jlt436-4000-lb-capacity-36-on-center-fork-pockets>: HTTP status code is not handled or not allowed
2026-01-10 20:00:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cleanshield-urinal-mat-6-mats-case-4065-4>: HTTP status code is not handled or not allowed
2026-01-10 20:00:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/250t3q-cl-250w-halogen-w-double-ended-base>: HTTP status code is not handled or not allowed
2026-01-10 20:00:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-3-shelf-boltless-shelving-add-on-48inw-x-12ind-x-96inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:00:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-4-shelf-boltless-shelving-add-on-36inw-x-12ind-x-96inh-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:00:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2631018-probe-rinse-w-sm-connector-for-hobart>: HTTP status code is not handled or not allowed
2026-01-10 20:00:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500q-cl-500w-halogen-w-dc-bay-base>: HTTP status code is not handled or not allowed
2026-01-10 20:00:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-easy-fold-mailers-18l-x-12w-x-2h-white-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:00:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-80-inch-high-post-chrome-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:00:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tyds14011-single-monitor-sit-stand-workstation-black>: HTTP status code is not handled or not allowed
2026-01-10 20:00:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-74-inch-high-post-chrome-4-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:00:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35mr16-fl-35w-halogen-w-minature-2-pin-round-base>: HTTP status code is not handled or not allowed
2026-01-10 20:00:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/65-gallon-rubbermaid-large-mobile-waste-receptacle-gray-with-lid>: HTTP status code is not handled or not allowed
2026-01-10 20:00:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35mr16-nsp-c-35w-halogen-w-minature-2-pin-round-base-24v>: HTTP status code is not handled or not allowed
2026-01-10 20:00:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pump-seal-kit-for-rol-lift-5500-capacity-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:00:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-triple-wall-corrugated-boxes-16l-x-16w-x-16h-kraft-pack-of-5>: HTTP status code is not handled or not allowed
2026-01-10 20:00:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-edge-work-bench-top-esd-72-w-x-30-d-x-1-1-4-thick>: HTTP status code is not handled or not allowed
2026-01-10 20:00:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2661136-cross-member-for-rearbearing-for-taylor-freezer>: HTTP status code is not handled or not allowed
2026-01-10 20:00:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500par56q-nsp-500w-sealed-beam-w-mogul-end-prong-base>: HTTP status code is not handled or not allowed
2026-01-10 20:00:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f32t8-841-env-32w-fluorescent-w-medium-bi-pin-base-cool-white>: HTTP status code is not handled or not allowed
2026-01-10 20:00:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zipt88d2-8-channel-hd-tvi-dvr-and-8-dome-camera-kit-2tb>: HTTP status code is not handled or not allowed
2026-01-10 20:00:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-literature-mailers-12l-x-9w-x-3h-white-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:00:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2x3-diamond-sof-tred-mat-black-1>: HTTP status code is not handled or not allowed
2026-01-10 20:00:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dispense-rite-3-section-wire-rack-cup-and-lid-organizer>: HTTP status code is not handled or not allowed
2026-01-10 20:00:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torque-limiting-socket-1-2-drive-21mm-110-ft-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:00:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-row-gtg-bleacher-w-mid-aisle-guardrail-21ft-l-dbl-footboard>: HTTP status code is not handled or not allowed
2026-01-10 20:00:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torque-limiting-socket-1-2-drive-21mm-60-ft-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:00:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-deluxe-literature-mailers-18l-x-12w-x-6h-kraft-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 20:00:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-line-single-track-seal-top-bag-with-hang-hole-2in-x-8in-2-mil-pkg-qty-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:00:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/893-filament-tape-2-x-60-yds-6-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:00:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/splined-shaft-1-3-4-dia-x-1-18-pilot-for-model-3700>: HTTP status code is not handled or not allowed
2026-01-10 20:00:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8915-clean-removal-filament-tape-3-4-x-60-yds-6-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:00:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-mailers-8l-x-3w-x-2h-kraft-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:00:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8934-filament-tape-3-x-60-yds-4-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:00:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-deluxe-literature-mailers-12-18l-x-9-14w-x-6h-kraft-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:00:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8934-filament-tape-1-x-60-yds-4-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:00:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cardboard-corrugated-boxes-19l-x-13w-x-10h-kraft-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 20:00:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cl-hepa-filter-for-cl-carpetmaster-112-115-212-215-218>: HTTP status code is not handled or not allowed
2026-01-10 20:00:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-composite-rib-corrugated-rubber-floor-mats-1-8-thick-x-3-x-4-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:00:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-deluxe-literature-mailers-17-18l-x-11-18w-x-3h-kraft-pk-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:00:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eu-vacuum-hepa-filter-for-eu-gd930>: HTTP status code is not handled or not allowed
2026-01-10 20:00:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-composite-rib-corrugated-rubber-floor-mats-1-8-thick-x-4-x-6-anti-slip-mat>: HTTP status code is not handled or not allowed
2026-01-10 20:00:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ph-paper-vacuum-bag-for-ph-390asb>: HTTP status code is not handled or not allowed
2026-01-10 20:00:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rigid-plate-caster-10-full-pneumatic-wheel-330-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:00:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheel-axle-size-5-8-5>: HTTP status code is not handled or not allowed
2026-01-10 20:00:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/back-ups-cs-500-bk500blk>: HTTP status code is not handled or not allowed
2026-01-10 20:00:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-500va-ups>: HTTP status code is not handled or not allowed
2026-01-10 20:00:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/homak-bk04004193-rs-pro-series-41w-x-24d-x-39h-9-drawer-black-roller-cabinet-with-lift-latch>: HTTP status code is not handled or not allowed
2026-01-10 20:00:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8402352-thermistor-cabinet-for-hoshizaki-of-america>: HTTP status code is not handled or not allowed
2026-01-10 20:00:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/homak-bk02065800-rs-pro-series-54-w-x-23-1-2-d-x-21-3-8-h-8-drawer-black-tool-chest>: HTTP status code is not handled or not allowed
2026-01-10 20:00:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torque-limiting-socket-1-2-drive-17mm-80-ft-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:00:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f21t5-830-env-21w-fluorescent-w-minature-bi-pin-base-warm-white>: HTTP status code is not handled or not allowed
2026-01-10 20:00:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-wall-gaylord-bottom-48l-x-48w-x-36h-kraft-pack-of-5>: HTTP status code is not handled or not allowed
2026-01-10 20:00:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-locker-number-plate-kit-pkg-of-200-numbered-2900-3099>: HTTP status code is not handled or not allowed
2026-01-10 20:00:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/homak-bk04054012-pro-ii-series-54w-x-24d-x-39h-10-drawer-black-roller-cabinet-with-lift-latch>: HTTP status code is not handled or not allowed
2026-01-10 20:00:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-desk-with-3-drawers-60-x-24-cherry>: HTTP status code is not handled or not allowed
2026-01-10 20:00:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tall-cardboard-corrugated-boxes-6l-x-6w-x-62h-kraft-pack-of-15>: HTTP status code is not handled or not allowed
2026-01-10 20:00:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1241401-switch-defrost-term-cooler-for-russell>: HTTP status code is not handled or not allowed
2026-01-10 20:00:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f8t5-d-8w-fluorescent-w-minature-bi-pin-base-daylight>: HTTP status code is not handled or not allowed
2026-01-10 20:00:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/461734-control-box-assembly>: HTTP status code is not handled or not allowed
2026-01-10 20:00:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cft26w-4p-830-26w-compact-fluorescent-w-gx24vq-3-base-warm>: HTTP status code is not handled or not allowed
2026-01-10 20:00:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-1039-bi-metal-main-switch>: HTTP status code is not handled or not allowed
2026-01-10 20:00:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apc-av-black-j15blk>: HTTP status code is not handled or not allowed
2026-01-10 20:00:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cft32w-4p-830-32w-compact-fluorescent-w-gx24vq-3-base-warm>: HTTP status code is not handled or not allowed
2026-01-10 20:01:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotary-pump-high-volume-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:01:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-4-1-8-d-x-23-5-8-d-x-4-h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:01:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/create-a-capbump-cap-insert-without-foam-for-6-panel-ball-cap-19404>: HTTP status code is not handled or not allowed
2026-01-10 20:01:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-wall-corrugated-sheets-48l-x-48w-white-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:01:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cf26dd-e-830-26w-compact-fluorescent-w-g24vq-3-base-warm-white>: HTTP status code is not handled or not allowed
2026-01-10 20:01:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gray-caressoft-vinyl-medical-stool-with-back-cushion-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:01:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-wall-corrugated-boxes-w-hand-holes-20l-x-18w-x-12h-kraft-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:01:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-8-3-8-w-x-17-7-8-d-x-4-h-blue-2>: HTTP status code is not handled or not allowed
2026-01-10 20:01:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012441-hose-assembly-mix-braided-for-electro-freeze>: HTTP status code is not handled or not allowed
2026-01-10 20:01:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8014210-switch-push-button-flush-red>: HTTP status code is not handled or not allowed
2026-01-10 20:01:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shop-press-50-ton-super-duty>: HTTP status code is not handled or not allowed
2026-01-10 20:01:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roller-follower-full-comp-inch-cry30vuur-crowned-od-double-sealed-1-78-od>: HTTP status code is not handled or not allowed
2026-01-10 20:01:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/75-ton-ironworker-3-phase-380v-50-hz-w-hydraulic-accessory-pack-iw75-3p380-ac600>: HTTP status code is not handled or not allowed
2026-01-10 20:01:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-bottle-jack-20-ton-super-duty-low-profile-air>: HTTP status code is not handled or not allowed
2026-01-10 20:01:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010375-thermometer-for-groen>: HTTP status code is not handled or not allowed
2026-01-10 20:01:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17094 pages (at 97 pages/min), scraped 7042 items (at 3 items/min)
2026-01-10 20:01:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conductive-bin-nestable-10>: HTTP status code is not handled or not allowed
2026-01-10 20:01:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fc8t9-ww-rs-22w-fluorescent-w-4-pin-base-warm-white>: HTTP status code is not handled or not allowed
2026-01-10 20:01:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sfsoap-lqd-soap-waloe-41-gl>: HTTP status code is not handled or not allowed
2026-01-10 20:01:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-triangular-cup-dolly-4200-cast-iron-wheels-1500-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:01:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ground-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:01:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-cardboard-corrugated-boxes-50l-x-12w-x-12h-kraft-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:01:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/travira-chaise-lounge-natural-sling-tekwood-vintage-armcaps-4-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:01:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-high-capacity-boltless-shelving-steel-deck-add-on-72inw-x-24ind-x-72inh>: HTTP status code is not handled or not allowed
2026-01-10 20:01:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/85t5-50-85w-compact-fluorescent-w-medium-base-natural-light>: HTTP status code is not handled or not allowed
2026-01-10 20:01:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-dividable-23>: HTTP status code is not handled or not allowed
2026-01-10 20:01:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dspbl-dust-head-48x5-cttnsyn-12>: HTTP status code is not handled or not allowed
2026-01-10 20:01:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/55-ton-ironworker-3-phase-230v-iw55-3p230>: HTTP status code is not handled or not allowed
2026-01-10 20:01:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jackson-safety-hhis-master-kit-for-climbing-hard-hats-blackred-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:01:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-153-deluxe-thermoplastic-coated-32-gallon-mesh-receptacle-w-rain-bonnet-lid-base-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:01:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/38-1265-high-temperature-wire-14-gauge-stranded-srgn-white-50-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:01:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grill-brick-8x4x35-12>: HTTP status code is not handled or not allowed
2026-01-10 20:01:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-153-deluxe-thermoplastic-coated-32-gallon-perforated-receptacle-w-dome-lid-base-green>: HTTP status code is not handled or not allowed
2026-01-10 20:01:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-box-accessory-short-divider-19>: HTTP status code is not handled or not allowed
2026-01-10 20:01:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4042-emergency-bldg-lamp-12w-sealed-beam-w-screw-terminal-base>: HTTP status code is not handled or not allowed
2026-01-10 20:01:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rlph1ns-long-sleeve-pullover-hoodie-with-uv-protection-l-hi-vis-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:01:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ind-qlty-steel-wool-hand-pad-1-med-126>: HTTP status code is not handled or not allowed
2026-01-10 20:01:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-max-compact-cordless-hammer-drill-driver-kit-1-2-brushless-li-ion-2-speed>: HTTP status code is not handled or not allowed
2026-01-10 20:01:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-max-cordless-circular-saw-7-1-4-5500-rpm-brushless-rubber-over-mold-grip>: HTTP status code is not handled or not allowed
2026-01-10 20:01:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-174-48-w-le-handed-return-table-mahogany-sg8030>: HTTP status code is not handled or not allowed
2026-01-10 20:01:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cut-resistant-gloves-micro-foam-nitrile-coated-ansi-a4-m-graypurple>: HTTP status code is not handled or not allowed
2026-01-10 20:01:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uhmw-polyethylene-plastic-bar-3-8-thick-x-1-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:01:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009344-pilot-kit-nat-for-henny-penny>: HTTP status code is not handled or not allowed
2026-01-10 20:01:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-mailbox-aluminum-pedestal-ground-mounted-black-48-h>: HTTP status code is not handled or not allowed
2026-01-10 20:01:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/581094-solenoid-valve1-2-inch-24v>: HTTP status code is not handled or not allowed
2026-01-10 20:01:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rlph1ns-long-sleeve-pullover-hoodie-with-uv-protection-2xl-hi-vis-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:01:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-back-aluminum-beverage-hand-truck-10-d-shoe-fenders-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:01:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/full-face-mesh-visor-black>: HTTP status code is not handled or not allowed
2026-01-10 20:01:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-leg-workbench-with-fixed-height-legs-8>: HTTP status code is not handled or not allowed
2026-01-10 20:01:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/loom-clamps-carbon-steel-6>: HTTP status code is not handled or not allowed
2026-01-10 20:01:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/loom-clamps-plated-steel-2>: HTTP status code is not handled or not allowed
2026-01-10 20:01:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-rod-3-diameter-x-6-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:01:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eagle-flammable-cabinet-with-manual-close-double-door-30-gallon>: HTTP status code is not handled or not allowed
2026-01-10 20:01:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-cantilever-rack-double-sided-add-on-heavy-duty-48-w-x-60-d-x-8-h-with-lip>: HTTP status code is not handled or not allowed
2026-01-10 20:01:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-filtered-exhaust-fan-direct-drive-totally-enclosed-3-phase-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 20:01:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quartz-infrared-heater-lamps-qih220-1350-l>: HTTP status code is not handled or not allowed
2026-01-10 20:01:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardian-booth-4-x-4-guard-booth-economy-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:01:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012304-filter-cartridge-cg5-20s>: HTTP status code is not handled or not allowed
2026-01-10 20:01:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-kit-with-pro-120-tool>: HTTP status code is not handled or not allowed
2026-01-10 20:01:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60a-bug-60w-incandescent-w-medium-base>: HTTP status code is not handled or not allowed
2026-01-10 20:01:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sit-stand-desk-mesh-chair-bundle-60-x-30-mahogany-black-base>: HTTP status code is not handled or not allowed
2026-01-10 20:01:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-i-hss-straight-flute-chucking-reamer-1710>: HTTP status code is not handled or not allowed
2026-01-10 20:01:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scratch-resistant-strip-door-curtain-10-w-x-7-h>: HTTP status code is not handled or not allowed
2026-01-10 20:01:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-60-computer-workstation-double-sided>: HTTP status code is not handled or not allowed
2026-01-10 20:01:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tripower-classical-section-molded-notch-vbelt-gates-bx40>: HTTP status code is not handled or not allowed
2026-01-10 20:01:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-1-8-thick-x-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:01:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/390-premium-uncoated-replacement-face-shield-window-8l-x-12w-x-116-thick-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:01:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010494-thermostat-gs>: HTTP status code is not handled or not allowed
2026-01-10 20:01:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scratch-resistant-strip-door-curtain-7-w-x-12-h>: HTTP status code is not handled or not allowed
2026-01-10 20:01:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-hc-narrow-section-molded-notch-vbelt-gates-3vx500>: HTTP status code is not handled or not allowed
2026-01-10 20:01:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fast-pack-spill-kit-universal-5-gallon-capacity-yellow-1300-ye>: HTTP status code is not handled or not allowed
2026-01-10 20:01:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scratch-resistant-strip-door-curtain-8-w-x-13-h>: HTTP status code is not handled or not allowed
2026-01-10 20:01:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/511607-pilot-burner-nat>: HTTP status code is not handled or not allowed
2026-01-10 20:01:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/telescoping-pole-expands-from-4-ft-to-11-ft-used-to-pull-and-replace-product-gates-91233>: HTTP status code is not handled or not allowed
2026-01-10 20:01:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009337-water-inlet-valve-120v-for-wilbur-curtis-co>: HTTP status code is not handled or not allowed
2026-01-10 20:01:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009338-pilot-burner-nat>: HTTP status code is not handled or not allowed
2026-01-10 20:01:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grill-protective-cover-for-indu-bistrogrill-island-57l-x-28w-x-36h>: HTTP status code is not handled or not allowed
2026-01-10 20:01:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wd-40-multi-use-lubricant-16-oz-aerosol-can-490088>: HTTP status code is not handled or not allowed
2026-01-10 20:01:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ensorbsuper-absorbent-spill-kit-universal-water-resistant-bag-enp-d710>: HTTP status code is not handled or not allowed
2026-01-10 20:01:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-adjustable-speed-force-electric-vibrator-scr-60>: HTTP status code is not handled or not allowed
2026-01-10 20:01:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8012114-orifice-hood-for-vulcan-hart>: HTTP status code is not handled or not allowed
2026-01-10 20:01:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-heavy-duty-electric-vibrator-2pcd-650-575v>: HTTP status code is not handled or not allowed
2026-01-10 20:01:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uhmw-polyethylene-plastic-bar-3-4-thick-x-4-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:01:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/25b9-1-2-25w-incandescent-w-european-base>: HTTP status code is not handled or not allowed
2026-01-10 20:01:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-653-ratchet-chain-lever-hoist-3t-capacity-15-lift>: HTTP status code is not handled or not allowed
2026-01-10 20:01:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gh328-vented-full-brim-hard-hat-4-point-adj-ratchet-suspension-carbon-fiber-black>: HTTP status code is not handled or not allowed
2026-01-10 20:01:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-small-impact-electric-vibrator-sprt-60>: HTTP status code is not handled or not allowed
2026-01-10 20:01:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cantilever-rack-straight-arm-with-1-lip>: HTTP status code is not handled or not allowed
2026-01-10 20:01:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-pneumatic-piston-vibrator-55-2s>: HTTP status code is not handled or not allowed
2026-01-10 20:01:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gh329-non-vented-full-brim-hard-hat-4-point-adjustable-ratchet-suspension-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:01:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/923-series-airtight-watertight-case-923-0007-18-5-8-l-x-14-3-8-w-x-6-5-16-h-graphite>: HTTP status code is not handled or not allowed
2026-01-10 20:01:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uhmw-polyethylene-plastic-sheet-3-8-thick-x-6-wide-x-6-long>: HTTP status code is not handled or not allowed
2026-01-10 20:01:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/381369-cord-set>: HTTP status code is not handled or not allowed
2026-01-10 20:01:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gh401-non-vented-safety-helmet-4-point-adjustable-ratchet-suspension-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:01:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/250-7-16-dia-6x26-extra-improved-plow-steel-galvanized-wire-rope-independent-wire-rope-center>: HTTP status code is not handled or not allowed
2026-01-10 20:01:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibco-silent-pneumatic-turbine-vibrator-bvs-130>: HTTP status code is not handled or not allowed
2026-01-10 20:01:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-sport-cone-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:01:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nest-only-container-21-3-8-x-15-5-16-x12-5-16-gray-closed-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:01:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/angel-soft-ps-premium-facial-tissue-flat-box-100box-2-ply-white>: HTTP status code is not handled or not allowed
2026-01-10 20:01:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-gallon-steel-drum-open-head>: HTTP status code is not handled or not allowed
2026-01-10 20:02:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-3-8-thick-x-4-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:02:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-1-8-thick-x-4-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:02:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulldog-aviation-sni-p>: HTTP status code is not handled or not allowed
2026-01-10 20:02:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ushio-egm-jcv120v-1000wbp28>: HTTP status code is not handled or not allowed
2026-01-10 20:02:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/840-style-woven-wire-panels-5w-x-10h>: HTTP status code is not handled or not allowed
2026-01-10 20:02:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-1-8-thick-x-1-1-2-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:02:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010656-control-assembly-for-alto-shaam>: HTTP status code is not handled or not allowed
2026-01-10 20:02:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-steel-container-blue-4>: HTTP status code is not handled or not allowed
2026-01-10 20:02:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kimberly-clark-pro-kimtech-science-kimwipes-delicate-task-wipers-90box>: HTTP status code is not handled or not allowed
2026-01-10 20:02:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-steel-container-drop-gate-green-2>: HTTP status code is not handled or not allowed
2026-01-10 20:02:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fibre-metal-174-cap-style-hard-hat-ratchet-suspension-royal-blue-hdpe-e2-series>: HTTP status code is not handled or not allowed
2026-01-10 20:02:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/milton-1864-twist-lock-universal-coupler-1-fnpt-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:02:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulk-container-forkli-able-with-hopper-front-5>: HTTP status code is not handled or not allowed
2026-01-10 20:02:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ushio-sm-8g101-sci-medlamp>: HTTP status code is not handled or not allowed
2026-01-10 20:02:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-1-thick-x-1-1-2-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:02:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8009507-orifice-1-4-18-mpt-56>: HTTP status code is not handled or not allowed
2026-01-10 20:02:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17194 pages (at 100 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:02:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/milton-s-785w-t-style-automotive-coupler-1-4-fnpt>: HTTP status code is not handled or not allowed
2026-01-10 20:02:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/verishield-153-behind-the-neck-ear-muffs-28-db-black>: HTTP status code is not handled or not allowed
2026-01-10 20:02:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5031098-float-switch-for-hoshizaki-of-america>: HTTP status code is not handled or not allowed
2026-01-10 20:02:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-3-4-thick-x-1-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:02:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-b11-ctc-light-bulb-e12-base-45w-300-lumens-2700k-warm-white-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:02:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-one-piece-clamping-collar-gm1c-12-b>: HTTP status code is not handled or not allowed
2026-01-10 20:02:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drum-cover-closed-head-drums-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:02:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rapidwire-welded-wire-4-sided-cage-w-5-sliding-door-20-6-x-20-6-x-10-5-1-4h>: HTTP status code is not handled or not allowed
2026-01-10 20:02:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/max-gel-clog-remover-unscented-1-qt-bottle>: HTTP status code is not handled or not allowed
2026-01-10 20:02:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/840-style-woven-wire-panels-9w-x-8h>: HTTP status code is not handled or not allowed
2026-01-10 20:02:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/milton-s-715-4w-m-style-industrial-coupler-4-piece-1-4-fnpt>: HTTP status code is not handled or not allowed
2026-01-10 20:02:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-two-piece-clamping-collar-gm2c-15-b>: HTTP status code is not handled or not allowed
2026-01-10 20:02:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-mobile-wire-bin-rack-36x24x69>: HTTP status code is not handled or not allowed
2026-01-10 20:02:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/840-style-security-station-bench-4l>: HTTP status code is not handled or not allowed
2026-01-10 20:02:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fifo-flow-rack-m53-side-extension-esd-54-44-83-w-x-31-49-71-d-x-73-3-13-h-3-levels-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:02:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/76-1205-10-inch-pre-filter-cartridge>: HTTP status code is not handled or not allowed
2026-01-10 20:02:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wireway-pallet-rack-tear-drop-upright-frame-144x36>: HTTP status code is not handled or not allowed
2026-01-10 20:02:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-mb312-maintenance-sorbent-mini-boom-3-x-12-4-boomscase>: HTTP status code is not handled or not allowed
2026-01-10 20:02:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-g2sc-300-b>: HTTP status code is not handled or not allowed
2026-01-10 20:02:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/photoluminescent-exit-to-street-left-down-nyc-mea-listed-aluminum-sign>: HTTP status code is not handled or not allowed
2026-01-10 20:02:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hp-556-petroleum-sorbent-static-resistant-pad-high-capacity-17-x-19-100-padscase>: HTTP status code is not handled or not allowed
2026-01-10 20:02:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-inch-w-push-broom-head-with-green-polypropylene-bristles-and-steel-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:02:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-gsc-131-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:02:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-mounted-mop-sink-20l-x-16w-x-12d-bowl>: HTTP status code is not handled or not allowed
2026-01-10 20:02:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010354-drain-valve-1-1-4-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:02:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8010356-ignitor-rh>: HTTP status code is not handled or not allowed
2026-01-10 20:02:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/381303-cord-set14-3-sjt-8-for-hamilton-beach>: HTTP status code is not handled or not allowed
2026-01-10 20:02:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quadruple-glove-box-holder-stainless-steel-hag21104>: HTTP status code is not handled or not allowed
2026-01-10 20:02:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-g1sc-193-b>: HTTP status code is not handled or not allowed
2026-01-10 20:02:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-par30-short-neck-colored-recessed-light-bulb-e26-base-8w-blue-pack-of-3>: HTTP status code is not handled or not allowed
2026-01-10 20:02:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sofia-modern-pendant-light-fixture-e26-base-40w-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 20:02:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suture-transport-cart-18-bins-22-diameter-star-base-31-41-height>: HTTP status code is not handled or not allowed
2026-01-10 20:02:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vapor-tight-industrial-jar-fixture-surface-mount-100w-120v-metallic-finish>: HTTP status code is not handled or not allowed
2026-01-10 20:02:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/59-x-24-adjustable-height-5-8-steel-work-platform>: HTTP status code is not handled or not allowed
2026-01-10 20:02:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/761272-cartridge-filter-im614-for-selecto-scientific-filters>: HTTP status code is not handled or not allowed
2026-01-10 20:02:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-outdoor-vapor-tight-fixture-surface-mount-21w-120-277v-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:02:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/71-x-24-adjustable-height-5-8-steel-work-platform>: HTTP status code is not handled or not allowed
2026-01-10 20:02:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48x36-maple-safety-edge-power-apron-production-bench-blue-32313784>: HTTP status code is not handled or not allowed
2026-01-10 20:02:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elkay-ezh2o-dual-hands-free-bi-level-stainless-steel-refrigerated-water-bottle-filling-station>: HTTP status code is not handled or not allowed
2026-01-10 20:02:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60x30-esd-safety-edge-power-apron-production-bench-blue-32313791>: HTTP status code is not handled or not allowed
2026-01-10 20:02:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90-torsion-spring-0-178-coil-dia-0-018-wire-dia-wound-right-302-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:02:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/loggia-rustic-farmhouse-pendant-light-fixture-e26-base-40w-gray-wood>: HTTP status code is not handled or not allowed
2026-01-10 20:02:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-8-9-h3-tmx-left-hand-bottoming-chamfer-hss-hand-tap-ground-4-flutes>: HTTP status code is not handled or not allowed
2026-01-10 20:02:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-8-27-hss-long-taper-tmx-pipe-tap-npt-ground-rh-4-flutes-4-inch-oal>: HTTP status code is not handled or not allowed
2026-01-10 20:02:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011254-thermostat-only-for-delfield>: HTTP status code is not handled or not allowed
2026-01-10 20:02:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/number-6-32-h2-set-of-3-one-each-taper-plug-and-bottoming-chamfer-hss-hand-tap-ground-rh-4-flutes>: HTTP status code is not handled or not allowed
2026-01-10 20:02:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iron-ageia0163-mens-6-internal-met-guard-work-boot-brown-size-9-w>: HTTP status code is not handled or not allowed
2026-01-10 20:02:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m5-0-x-80-d4-bottoming-chamfer-iso-metric-hss-tm-x-hand-tap-ground-rh-4-flutes>: HTTP status code is not handled or not allowed
2026-01-10 20:02:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-gsc-225-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:02:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m16-x-2-0-d7-plug-chamfer-iso-metric-hss-tm-x-hand-tap-ground-rh-4-flutes>: HTTP status code is not handled or not allowed
2026-01-10 20:02:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-round-outdoor-post-top-light-fixture-55w-7150-lumens-15-dia-bronze>: HTTP status code is not handled or not allowed
2026-01-10 20:02:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-gsc-218-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:02:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reebokrb1910-mens-classic-skateboard-shoe-black-size-11-w>: HTTP status code is not handled or not allowed
2026-01-10 20:02:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m6-0x-1-0-d5-spiral-pt-plug-chamfer-iso-metric-hss-tmx-hand-tap-ground-rh-2-flutes>: HTTP status code is not handled or not allowed
2026-01-10 20:02:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/std050334-10-hp-oil-less-scroll-comp-80-gal-horiz-116-psi-3-phase-230v-refrigerated-dryer>: HTTP status code is not handled or not allowed
2026-01-10 20:02:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-g1sc-012-b>: HTTP status code is not handled or not allowed
2026-01-10 20:02:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m24-x-1-5-d5-plug-chamfer-iso-metric-hss-tm-x-hand-tap-ground-rh-4-flutes>: HTTP status code is not handled or not allowed
2026-01-10 20:02:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ulti-mate-garage-2-0-series-7-piece-tall-cabinet-set-248-5-x-21-x-80-black>: HTTP status code is not handled or not allowed
2026-01-10 20:02:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/faultless-swivel-plate-caster-8-polyurethane-wheel>: HTTP status code is not handled or not allowed
2026-01-10 20:02:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seh30073hp-30-hp-oil-less-scroll-compressor-tankless-145-psi-3-phase-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:02:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-x-30-steel-square-edge-with-drawer>: HTTP status code is not handled or not allowed
2026-01-10 20:02:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ulti-mate-garage-2-0-series-tall-cabinet-set-35-5-x-21-x-80-white>: HTTP status code is not handled or not allowed
2026-01-10 20:02:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seq20073-20-hp-oil-less-scroll-compressor-tankless-116-psi-3-phase-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:02:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-suffocation-warning-poly-bags-11-w-x-14-l-2-mil-clear-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:02:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-valve-5-port-2-pos-man-valve-1-8-nptf-port-palm-actr-air-spring-ret>: HTTP status code is not handled or not allowed
2026-01-10 20:02:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ulti-mate-garage-2-0-series-3-piece-tall-cabinet-set-106-5-x-21-x-80-red>: HTTP status code is not handled or not allowed
2026-01-10 20:02:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-0-1-oil-hardening-flat-stock-1-2x1-16x18>: HTTP status code is not handled or not allowed
2026-01-10 20:02:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/made-in-usa-0-1-oil-hardening-flat-stock-1-2x7-32x36>: HTTP status code is not handled or not allowed
2026-01-10 20:02:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sts10b444-10-hp-oil-less-scroll-comp-120-gal-horiz-116-psi-3-phase-460v-refrigerated-dryer>: HTTP status code is not handled or not allowed
2026-01-10 20:02:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5641011-valve-pressure-relief-for-broaster>: HTTP status code is not handled or not allowed
2026-01-10 20:02:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/venture-patio-umbrella-w-silver-pole-132w-sunbrella-1a-spectrum-dove-fabric>: HTTP status code is not handled or not allowed
2026-01-10 20:02:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spill-containment-sump-base-module>: HTTP status code is not handled or not allowed
2026-01-10 20:02:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spill-containment-sump-stack-module>: HTTP status code is not handled or not allowed
2026-01-10 20:02:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bearkat-bk119-safety-glasses-bk1-indooroutdoor-clear-mirror-lens>: HTTP status code is not handled or not allowed
2026-01-10 20:02:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/column-press-3-4-ton-pneumatic-column-press-w-4-bore-x-2-stroke-cylinder-mounted>: HTTP status code is not handled or not allowed
2026-01-10 20:02:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sts030132hp-3-hp-oil-less-scroll-compressor-30-gal-horizontal-145-psi-3-phase-208-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:02:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011653-gas-pilot-valve>: HTTP status code is not handled or not allowed
2026-01-10 20:02:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-linear-bar-vanity-light-fixture-20w-1100-lumens-18l-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 20:02:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aah-48rbmag3-c-storage-cabinet-all-welded-48-wx24-dx78-h-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 20:02:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-coupling-g2scc-150-150>: HTTP status code is not handled or not allowed
2026-01-10 20:02:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/made-in-usa-o-1-oil-hardening-drill-rod-1-8>: HTTP status code is not handled or not allowed
2026-01-10 20:02:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/511098-repair-kit-v-b-1-4-inch-to-3-8-inch-watts>: HTTP status code is not handled or not allowed
2026-01-10 20:02:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-vertical-file-legal-size-4-drawer-black-18w-x-26-1-2d-x-52h>: HTTP status code is not handled or not allowed
2026-01-10 20:03:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/38-1332-ignition-cable-29-inch-with-spark-plug-ends>: HTTP status code is not handled or not allowed
2026-01-10 20:03:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-367213-n-bookcase-all-welded-36-wx13-dx72-h-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:03:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aah-48rbmag3-ts-storage-cabinet-all-welded-48-wx24-dx78-h-tropic-sand>: HTTP status code is not handled or not allowed
2026-01-10 20:03:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8011349-main-pcb-for-turbo-air-refrigeration>: HTTP status code is not handled or not allowed
2026-01-10 20:03:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/made-in-usa-o-1-oil-hardening-drill-rod-30mm>: HTTP status code is not handled or not allowed
2026-01-10 20:03:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-368413-pt-grn-bookcase-all-welded-36-wx13-dx84-h-pastel-green>: HTTP status code is not handled or not allowed
2026-01-10 20:03:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-g2sc-050-b>: HTTP status code is not handled or not allowed
2026-01-10 20:03:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dental-lab-chair-with-vinyl-seat-and-mesh-backrest-black>: HTTP status code is not handled or not allowed
2026-01-10 20:03:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p329-battery-powered-strapping-tool-kit-5-8-w-plastic-strapping>: HTTP status code is not handled or not allowed
2026-01-10 20:03:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-16-w-7-step-steel-rolling-ladder-21-d-top-step-w-handrails-orange-w-cal-osha-handrail-cal-fsh71821p-o>: HTTP status code is not handled or not allowed
2026-01-10 20:03:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-decorative-vanity-light-fixture-30w-1950-lumens-23l-brushed-nickel>: HTTP status code is not handled or not allowed
2026-01-10 20:03:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-faces-2-for-the-standard-qla-24-x-36-x-4-mm-white-message-board>: HTTP status code is not handled or not allowed
2026-01-10 20:03:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-dual-access-fiberglass-platform-ladder>: HTTP status code is not handled or not allowed
2026-01-10 20:03:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-valve-5-port-2-pos-man-valve-1-8-nptf-port-basic-valve-for-side-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:03:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-24-wx72-d-stainless-steel-rolling-safety-ladder-serrated-grating-w-cal-osha-handrail-cal-ss073228g>: HTTP status code is not handled or not allowed
2026-01-10 20:03:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tub-cart-black-32-x-18-2-shelves-2-outrigger-utility-cart-bins-150-lbs-shelf-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:03:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17293 pages (at 99 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:03:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-364213-db-bookcase-all-welded-36-wx13-dx42-h-denim-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:03:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conntek-30123-20-to-15-20-amp-generator-locking-adapter-with-nema-l5-20p-to-5-15-20r-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:03:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contour-bench-recycled-plastic-6-ft-cedar>: HTTP status code is not handled or not allowed
2026-01-10 20:03:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aah-48rbmag3-bl-storage-cabinet-all-welded-48-wx24-dx78-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:03:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heritage-bench-recycled-plastic-6-ft-black-frame-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:03:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/newport-patio-umbrella-w-silver-pole-108w-sunbrella-2a-cabana-classic-fabric>: HTTP status code is not handled or not allowed
2026-01-10 20:03:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-steel-safety-rolling-ladder-w-weight-actuated-lock-16-w-expanded-step-orange-w-cal-osha-handrail-cal-wa062414x-o>: HTTP status code is not handled or not allowed
2026-01-10 20:03:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nesting-cutlery-box-14-3-16-l-x-4-7-16-w-x-4-1-8-h-cutlery-box-polypropylene-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:03:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nesting-cutlery-box-14-3-16-l-x-4-7-16-w-x-4-1-8-h-cutlery-box-polypropylene-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:03:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-roll-dispenser-kit-5104jc>: HTTP status code is not handled or not allowed
2026-01-10 20:03:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-deck-truck-36-l-x-24-w-2400-lb-capacity-with-ergo-handle-1>: HTTP status code is not handled or not allowed
2026-01-10 20:03:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suspended-scaffolding-safety-dvd-program>: HTTP status code is not handled or not allowed
2026-01-10 20:03:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gtek-nitrile-microsurface-nylon-grip-gloves-x-large>: HTTP status code is not handled or not allowed
2026-01-10 20:03:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-16-w-5-step-steel-rolling-ladder-14-d-top-step-w-handrails-orange-w-cal-osha-handrail-cal-fsh518p-o>: HTTP status code is not handled or not allowed
2026-01-10 20:03:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-dolly-36-l-x-24-w-with-open-deck-rubber-wheels>: HTTP status code is not handled or not allowed
2026-01-10 20:03:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bca-367213-c-bookcase-all-welded-36-wx13-dx72-h-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 20:03:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wellness-fitness-dvd-program>: HTTP status code is not handled or not allowed
2026-01-10 20:03:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-w-x-24-h-x-4-d-mini-pleated-merv-13-air-filter-single-header-global-industrial>: HTTP status code is not handled or not allowed
2026-01-10 20:03:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cfmt-umbrella-base-with-steel-cover-19-34w-white>: HTTP status code is not handled or not allowed
2026-01-10 20:03:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-stop-bollard-with-removable-caps-48height>: HTTP status code is not handled or not allowed
2026-01-10 20:03:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/charger-chg122a>: HTTP status code is not handled or not allowed
2026-01-10 20:03:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pegboard-back-panel-46-17-32-x-65-13-16-h>: HTTP status code is not handled or not allowed
2026-01-10 20:03:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mooreco-iteach-spider-flat-panel-cart-electric-height-adjustable>: HTTP status code is not handled or not allowed
2026-01-10 20:03:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss-hose-braid-w-male-npt-nipple-2-5-x-18>: HTTP status code is not handled or not allowed
2026-01-10 20:03:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-step-extra-heavy-duty-steel-rolling-safety-ladder-perforated-tread-w-cal-osha-handrail-cal-ml093221p>: HTTP status code is not handled or not allowed
2026-01-10 20:03:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-conditioner-condensing-unit-14-seer2-5-ton-208230v>: HTTP status code is not handled or not allowed
2026-01-10 20:03:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gauze-bandages-single-roll-3-x5yds-12-pcs>: HTTP status code is not handled or not allowed
2026-01-10 20:03:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanofiber-filter-for-attx-19-xc>: HTTP status code is not handled or not allowed
2026-01-10 20:03:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-step-16-w-stainless-steel-fold-and-store-rolling-ladder-heavy-duty-serrated-grating-w-cal-osha-handrail-cal-ssfawl-11g>: HTTP status code is not handled or not allowed
2026-01-10 20:03:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-bariatric-folding-bedside-commode-seat>: HTTP status code is not handled or not allowed
2026-01-10 20:03:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zoneaire-select-packaged-terminal-air-conditioner-with-electric-heat-9300-btu-cool-208230v>: HTTP status code is not handled or not allowed
2026-01-10 20:03:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zoneaire-select-packaged-terminal-air-conditioner-with-electric-heat-12000-btu-cool-208230v>: HTTP status code is not handled or not allowed
2026-01-10 20:03:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-16-wx65-d-stainless-steel-rolling-safety-ladder-perforated-tread-w-cal-osha-handrail-cal-ss072421p>: HTTP status code is not handled or not allowed
2026-01-10 20:03:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-16-wx59-d-stainless-steel-rolling-safety-ladder-perforated-tread-w-cal-osha-handrail-cal-ss062421p>: HTTP status code is not handled or not allowed
2026-01-10 20:03:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-roll-splint>: HTTP status code is not handled or not allowed
2026-01-10 20:03:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alum-rollator-fold-up-removable-back-support-padded-seat-8-inch-casters-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:03:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-steel-safety-rolling-ladder-w-weight-actuated-lock-16-w-serrated-step-orange-w-cal-osha-handrail-cal-wa072414g-o>: HTTP status code is not handled or not allowed
2026-01-10 20:03:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-folding-security-gate-10-x-8>: HTTP status code is not handled or not allowed
2026-01-10 20:03:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-dual-channel-tens-unit-agf-3x-welectrodes-carry-case-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:03:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-w-x-12-h-x-2-d-pleated-merv-11-high-capacity-air-filter-global-industrial>: HTTP status code is not handled or not allowed
2026-01-10 20:03:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medical-supply-pack-f>: HTTP status code is not handled or not allowed
2026-01-10 20:03:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medical-supply-pack-h>: HTTP status code is not handled or not allowed
2026-01-10 20:03:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/line-set-12-suction-insulation-38-od-x-34-od-x-50l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:03:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-step-steel-stock-picking-ladder-perforated-tread-w-cal-osha-handrail-cal-spl-12-p>: HTTP status code is not handled or not allowed
2026-01-10 20:03:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infinity-locker-single-tier-12x18x60-1-door-assembled-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:03:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-7w-x-82h-pepper-dust>: HTTP status code is not handled or not allowed
2026-01-10 20:03:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-10w-x-82h-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 20:03:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-wheelchair-oxygen-inche-inch-cylinder-holder-with-iv-pole>: HTTP status code is not handled or not allowed
2026-01-10 20:03:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-spring-action-belt-clip-for-xpr-series-radios>: HTTP status code is not handled or not allowed
2026-01-10 20:03:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48x96-slatwall-panel-without-inserts>: HTTP status code is not handled or not allowed
2026-01-10 20:03:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bl-364pt-w-counter-high-storage-cabinet-w--plastic-top-all-welded-36-x18x42--white>: HTTP status code is not handled or not allowed
2026-01-10 20:03:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maah-48662rb-db-mobile-cabinet-all-welded-36-wx24-dx66-h-denim-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:03:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-outward-swing-partition-door-w-hardware-24w-azure>: HTTP status code is not handled or not allowed
2026-01-10 20:03:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-pilaster-w-shoe-22w-x-82h-black-confetti>: HTTP status code is not handled or not allowed
2026-01-10 20:03:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-pilaster-w-shoe-18w-x-82h-olive>: HTTP status code is not handled or not allowed
2026-01-10 20:03:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-unit-desktop-charger-for-cp100d-portable-radios>: HTTP status code is not handled or not allowed
2026-01-10 20:03:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-locker-sloping-top-36-w-x-18-d-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:03:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-steel-stock-picking-ladder-perforated-tread-w-cal-osha-handrail-cal-spl-6-14np>: HTTP status code is not handled or not allowed
2026-01-10 20:03:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s102007-wire-rope-sling-1-2-x-10-eye-and-eye-3800-5000-10000-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:03:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cooling-gel-memory-foam-backrest-14-18x14-18x2-34-black>: HTTP status code is not handled or not allowed
2026-01-10 20:03:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-front-for-powr-flite-pas145>: HTTP status code is not handled or not allowed
2026-01-10 20:03:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-3w-x-82h-almond>: HTTP status code is not handled or not allowed
2026-01-10 20:03:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/web-sling-1-ply-endless-3-long-1-wide>: HTTP status code is not handled or not allowed
2026-01-10 20:03:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s201038-12-poly-web-sling-endless-24800-31000-62000-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:03:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b151024-20-single-leg-chain-sling-w-sling-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:03:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-front-for-nilfisk-advance-vf81215>: HTTP status code is not handled or not allowed
2026-01-10 20:03:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/breakdown-odor-eliminator-fresh-scent-1-gallon-bottle-4case>: HTTP status code is not handled or not allowed
2026-01-10 20:03:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-closed-linear-bearing-sw48-3id-6l>: HTTP status code is not handled or not allowed
2026-01-10 20:03:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-closed-linear-bearing-sws16-1id-225l>: HTTP status code is not handled or not allowed
2026-01-10 20:03:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-skirt-for-nilfisk-advance-56412107>: HTTP status code is not handled or not allowed
2026-01-10 20:03:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bradley-wash-fountain-semi-circular-110-24-vac-25>: HTTP status code is not handled or not allowed
2026-01-10 20:03:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-closed-linear-bearing-sw20-14id-2625l>: HTTP status code is not handled or not allowed
2026-01-10 20:03:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s201028-10-poly-web-sling-endless-10560-13200-26400-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:03:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-closed-linear-bearing-w-resin-retainer-and-seals-sw6guu-38id-0875l>: HTTP status code is not handled or not allowed
2026-01-10 20:03:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plain-magnetic-roll-stock-100l-x-2-14h-x-003-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:03:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1818-1-2-6in-oal-hss-heavy-duty-sand-blasted-118-point-carbide-tipped-masonry-drill>: HTTP status code is not handled or not allowed
2026-01-10 20:03:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-6w-x-82h-khaki>: HTTP status code is not handled or not allowed
2026-01-10 20:03:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-22w-x-82h-royal-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:03:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bradley-shower-eye-face-wash-station-s19-310ac>: HTTP status code is not handled or not allowed
2026-01-10 20:03:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1802-7-00mm-cobalt-heavy-duty-straw-135-split-point-jobber-length-drill>: HTTP status code is not handled or not allowed
2026-01-10 20:03:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-front-3-16-neo-for-nobles-tennant-390923>: HTTP status code is not handled or not allowed
2026-01-10 20:03:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-front-for-factory-cat-25-755g>: HTTP status code is not handled or not allowed
2026-01-10 20:03:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duraline-economy-tubular-dunnage-rack-24-inch-w-48-inch-l-12-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 20:03:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s152031-10-poly-web-sling-eye-and-eye-2560-3200-6400-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:04:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suma174-pan-clean-premium-pot--pan-detergent-floral-scent-25-l-bottle-2case>: HTTP status code is not handled or not allowed
2026-01-10 20:04:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-elevated-plastic-box-truck-6-bushel-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:04:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/warehouse-safety-dvd-program>: HTTP status code is not handled or not allowed
2026-01-10 20:04:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-inch-flush-bridge-in-espresso-executive-modular-furniture>: HTTP status code is not handled or not allowed
2026-01-10 20:04:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-rear-a-for-nilfisk-advance-56314303>: HTTP status code is not handled or not allowed
2026-01-10 20:04:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s152026-2-poly-web-sling-eye-and-eye-2560-3200-6400-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:04:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b151020-8-single-leg-chain-sling-w-sling-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:04:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infinity-8482-locker-3-tier-12-x-15-x-24-3-door-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:04:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stop-arm-adjustable-closer-hold-open-duranodic>: HTTP status code is not handled or not allowed
2026-01-10 20:04:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-squeegee-set-for-factory-cat-22-770l-factory-cat-22-754l-factory-cat-22-755l>: HTTP status code is not handled or not allowed
2026-01-10 20:04:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b152004-8-quad-leg-chain-sling-w-sling-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:04:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-12w-x-82h-royal-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:04:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1823-7-16-heavy-duty-steam-oxide-power-wood-bits-drill>: HTTP status code is not handled or not allowed
2026-01-10 20:04:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-step-roses-storeroom-lock-dull-chrome-clutch>: HTTP status code is not handled or not allowed
2026-01-10 20:04:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-5w-x-82h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:04:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-tier-1-door-digital-locker-12inwx15indx66inh-gray-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:04:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17393 pages (at 100 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:04:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-tier-1-door-digital-locker-12inwx15indx66inh-tan-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:04:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tracmat-16l-x-3w-for-16-x-16-containment-berm-2-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:04:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digital-door-lock-2200-surface-rim-mount-jet-black>: HTTP status code is not handled or not allowed
2026-01-10 20:04:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b151078-4-single-leg-chain-sling-w-sling-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:04:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-signs-danger-high-voltage-keep-out-rigid-plastic-7-h-x-10-w>: HTTP status code is not handled or not allowed
2026-01-10 20:04:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-22w-x-82h-dark-khaki>: HTTP status code is not handled or not allowed
2026-01-10 20:04:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23468-1-2-3-4-pex-combo-tool>: HTTP status code is not handled or not allowed
2026-01-10 20:04:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b151059-8-single-leg-chain-sling-w-grab-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:04:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b152018-6-quad-leg-chain-sling-w-sling-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:04:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hard-hat-ratchet-white>: HTTP status code is not handled or not allowed
2026-01-10 20:04:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-inward-swing-partition-door-26w-burgundy>: HTTP status code is not handled or not allowed
2026-01-10 20:04:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s152055-8-poly-web-sling-endless-2500-3200-6400-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:04:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-vac-motor-td-for-alto-clarke-45019a>: HTTP status code is not handled or not allowed
2026-01-10 20:04:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s152054-6-poly-web-sling-endless-2500-3200-6400-lbs-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:04:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-side-for-nobles-tennant-1031011>: HTTP status code is not handled or not allowed
2026-01-10 20:04:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1878-7-16-hss-heavy-duty-black-gold-135-split-point-3-flatted-shank-jobber-length-drill>: HTTP status code is not handled or not allowed
2026-01-10 20:04:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7195-03-deluxe-spanbak-back-support-large>: HTTP status code is not handled or not allowed
2026-01-10 20:04:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hanging-rail-72>: HTTP status code is not handled or not allowed
2026-01-10 20:04:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-skirt-for-nobles-tennant-1011376>: HTTP status code is not handled or not allowed
2026-01-10 20:04:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardian-low-profile-scissor-lift-table-hand-operated-3300-lb-cap-61l-x-32w-115v>: HTTP status code is not handled or not allowed
2026-01-10 20:04:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-squeegee-front-for-ice-8311534>: HTTP status code is not handled or not allowed
2026-01-10 20:04:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-locker-double-tier-3-wide-12-3-4w-x-18d-x-36-1-2h-tan-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:04:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-inward-swing-partition-door-26w-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 20:04:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-climax-2c-012>: HTTP status code is not handled or not allowed
2026-01-10 20:04:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1896-27-64-hss-heavy-duty-steam-oxide-135-split-point-screw-machine-drill>: HTTP status code is not handled or not allowed
2026-01-10 20:04:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cluster-box-unit-8-a-size-doors-type-i-bronze-usps-access>: HTTP status code is not handled or not allowed
2026-01-10 20:04:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steamclean-microfiber-cloth-set-for-sg-4-4-2-863-171-0>: HTTP status code is not handled or not allowed
2026-01-10 20:04:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cluster-box-unit-16-a-size-doors-type-iii-green-usps-access>: HTTP status code is not handled or not allowed
2026-01-10 20:04:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phenolic-black-core-partition-panel-wo-brackets-5412w-folkstone-celesta>: HTTP status code is not handled or not allowed
2026-01-10 20:04:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-pilaster-w-shoe-7w-x-82h-mocha>: HTTP status code is not handled or not allowed
2026-01-10 20:04:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-partition-panel-wo-brackets-5912w-azure>: HTTP status code is not handled or not allowed
2026-01-10 20:04:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-petg-media-bottles-sterile-tray-pack-60ml-case-of-200>: HTTP status code is not handled or not allowed
2026-01-10 20:04:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-caressoftplus-guest-chair-black>: HTTP status code is not handled or not allowed
2026-01-10 20:04:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-rectangular-strip-carbide-blank-116x14x3-stb28d>: HTTP status code is not handled or not allowed
2026-01-10 20:04:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-rectangular-strip-carbide-blank-18x38x12-stb412l>: HTTP status code is not handled or not allowed
2026-01-10 20:04:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-cylindrical-brush-24-sr-for-nobles-tennant-1030969>: HTTP status code is not handled or not allowed
2026-01-10 20:04:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-climax-1c-156-z>: HTTP status code is not handled or not allowed
2026-01-10 20:04:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-panel-wo-brackets-5412w-canyon-zephyr>: HTTP status code is not handled or not allowed
2026-01-10 20:04:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-tank-lid-for-nobles-tennant-1017959-nobles-tennant-1017958>: HTTP status code is not handled or not allowed
2026-01-10 20:04:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vented-plastic-shelf-72x18-nexelon-finish-1>: HTTP status code is not handled or not allowed
2026-01-10 20:04:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/siz-11-oval-sizzling-platter>: HTTP status code is not handled or not allowed
2026-01-10 20:04:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/150-17-64-hss-general-purpose-steam-oxide-118-point-jobber-length-drill>: HTTP status code is not handled or not allowed
2026-01-10 20:04:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacment-panel-filter-for-nilfisk-advance-8-24-04139-1>: HTTP status code is not handled or not allowed
2026-01-10 20:04:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-climax-2c-262-z>: HTTP status code is not handled or not allowed
2026-01-10 20:04:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-climax-2c-068-s>: HTTP status code is not handled or not allowed
2026-01-10 20:04:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-safety-cargo-pant-38-waist-x-34l-inseam-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:04:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12673-6685-dry-evaporative-cooling-vest-lime-m>: HTTP status code is not handled or not allowed
2026-01-10 20:04:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-resistant-safety-cargo-pant-42-waist-x-32l-inseam-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:04:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-filter-mesh-solution-strainer-for-nobles-tennant-398770>: HTTP status code is not handled or not allowed
2026-01-10 20:04:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-carbon-fiber-tube-unidirectional-3-8-id-x-1-2-od-x-4-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:04:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-solution-valve-for-nobles-tennant-1022106-nobles-tennant-9016494>: HTTP status code is not handled or not allowed
2026-01-10 20:04:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-w-shoe-6w-x-82h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:04:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-x-9-x-6-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:04:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-flame-resistant-button-up-safety-shirt-cottonnylon-2xl-hi-vis-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:04:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-6-x-8-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:04:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40402-2-2x3x-extreme-sport-life-vest-red-2x-large3x-large>: HTTP status code is not handled or not allowed
2026-01-10 20:04:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-recessed-screw-climax-h2c-012>: HTTP status code is not handled or not allowed
2026-01-10 20:04:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/abc-industries-thermohose-1399-heater-duct-8-dia-x-16l-x-4-pitch-yellowblack>: HTTP status code is not handled or not allowed
2026-01-10 20:04:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/psm-r-rare-steak-markers>: HTTP status code is not handled or not allowed
2026-01-10 20:04:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-carbon-fiber-sheet-unidirectional-1-16-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:04:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-partition-panel-wo-brackets-5712w-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:04:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40301-2-cld-all-sport-life-vest-blue-child>: HTTP status code is not handled or not allowed
2026-01-10 20:04:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-partition-panel-wo-brackets-5912w-moss>: HTTP status code is not handled or not allowed
2026-01-10 20:04:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-two-piece-industry-standard-clamping-couplings-w-keyway-climax-2miscc-30-30skw>: HTTP status code is not handled or not allowed
2026-01-10 20:04:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-cleaner-pleasant-scent-32-oz-spray-bottle-8carton>: HTTP status code is not handled or not allowed
2026-01-10 20:04:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/easy-trap-duster-8-x-125-ft-white-1-250-sheet-rollcarton>: HTTP status code is not handled or not allowed
2026-01-10 20:04:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/13-3-4-x-10-1-4-x-9-1-8-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:04:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/psm-w-well-steak-markers>: HTTP status code is not handled or not allowed
2026-01-10 20:04:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-chair-with-back-vinyl-marine-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:04:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scp-15-sauce-cup-1-1-2-oz-stainless-steel-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:04:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-visibility-flame-resistant-safety-coveralls-2xl-hi-vis-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:04:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-panel-wo-brackets-5712w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:04:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/psw-12r-wide-mouth-squeeze-bottles-12-oz>: HTTP status code is not handled or not allowed
2026-01-10 20:04:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-x-6-x-6-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:04:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polymer-pilaster-w-shoe-4w-x-82h-ivory-essence-speckle>: HTTP status code is not handled or not allowed
2026-01-10 20:04:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedcartt-18-60-63-back-to-back-50-cells-10-8-11>: HTTP status code is not handled or not allowed
2026-01-10 20:04:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-x-10-x-10-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:04:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/abc-industries-enviroduct-1399-insulated-heater-duct-20-dia-x-25l-x-7-pitch-white>: HTTP status code is not handled or not allowed
2026-01-10 20:04:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-safety-helmet-novent-fas-trac-iii-pivot-ansi-csa-en397-white>: HTTP status code is not handled or not allowed
2026-01-10 20:04:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-industry-standard-clamping-couplings-w-keyway-climax-2iscc150-150skw>: HTTP status code is not handled or not allowed
2026-01-10 20:04:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/psw-16y-wide-mouth-squeeze-bottles-16-oz>: HTTP status code is not handled or not allowed
2026-01-10 20:04:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-pilaster-w-shoe-22w-x-82h-storm-solidz>: HTTP status code is not handled or not allowed
2026-01-10 20:04:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/disinfectant-sprays-eucalyptusspearmintthyme-139-oz-spray-bottle>: HTTP status code is not handled or not allowed
2026-01-10 20:04:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stack-pack-2-drawer-tool-box-22l-x-15-18w-x-16-516h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:05:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peel-stick-seam-tape-2-x-50-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:05:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-two-piece-industry-standard-clamping-couplings-climax-2miscc-06-06-s>: HTTP status code is not handled or not allowed
2026-01-10 20:05:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-climax-1c-112>: HTTP status code is not handled or not allowed
2026-01-10 20:05:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/squids-3703-bulk-elastic-loop-tool-tails-ext-standard-lime-15lbs-60-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:05:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-pilaster-w-shoe-12w-x-82h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:05:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arsenal-5561-small-tool-and-radio-holster-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:05:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-scoop-82-oz-purple>: HTTP status code is not handled or not allowed
2026-01-10 20:05:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-pilaster-w-shoe-24w-x-82h-almond>: HTTP status code is not handled or not allowed
2026-01-10 20:05:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mega-scoop-128-oz-green>: HTTP status code is not handled or not allowed
2026-01-10 20:05:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-scoop-32-oz-red>: HTTP status code is not handled or not allowed
2026-01-10 20:05:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slotted-full-brim-hat-with-1-touch-suspension-hi-viz-yellow-green>: HTTP status code is not handled or not allowed
2026-01-10 20:05:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-wipe-dispenser-holder-holds-4-12-dia-bottle-5w-x-5-18d-x-5-38h-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:05:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-linen-le-phenolic-rod-0-750-dia-x-48-000-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:05:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indoor-outdoor-sidebar-table-with-tablet-holder>: HTTP status code is not handled or not allowed
2026-01-10 20:05:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rp-3w-plain-ramekins-3-oz-melamine-white>: HTTP status code is not handled or not allowed
2026-01-10 20:05:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17492 pages (at 99 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:05:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nashville-wire-steel-cargo-cart-open-front-48w-x-24d-x-70h>: HTTP status code is not handled or not allowed
2026-01-10 20:05:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optional-adjustable-height-shelf-for-rc3248-nashville-wire-cart>: HTTP status code is not handled or not allowed
2026-01-10 20:05:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-24-x-18-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:05:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cordless-12-mid-torque-impact-wrench-kit-with-35ah-stacked-lithium-ion-battery-24v>: HTTP status code is not handled or not allowed
2026-01-10 20:05:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-canvas-ce-phenolic-sheet-0-500-x-48-000-x-96-000>: HTTP status code is not handled or not allowed
2026-01-10 20:05:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o-201-general-purpose-polyolefin-cf-shrink-film-75-ga-16w-x-3500l-clear-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:05:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o-201-general-purpose-polyolefin-cf-shrink-film-50-ga-20w-x-5250l-clear-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:05:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-inward-swing-door-w-hardware-26w-taupe>: HTTP status code is not handled or not allowed
2026-01-10 20:05:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ductless-mini-split-ac-heat-pump-wi-fi-control-12000-btu-17-seer-115v-25-lineset-white>: HTTP status code is not handled or not allowed
2026-01-10 20:05:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-all-stainless-pressure-gauge-1-2-npt-0-200-psi-dry-fillable-lm-4001-2lg-gf>: HTTP status code is not handled or not allowed
2026-01-10 20:05:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-x-16-x-6-4-2-multi-depth-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:05:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/61554-aware-wear-hi-vis-pull-over-sweatshirt-class-3-hi-vis-lime-black-5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:05:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o-201-general-purpose-polyolefin-cf-shrink-film-75-ga-24w-x-3500l-clear-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:05:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62986-aware-wear-hi-vis-zipper-sweatshirt-class-3-hi-vis-lime-black-l>: HTTP status code is not handled or not allowed
2026-01-10 20:05:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-x-36-x-36-24-22-20-multi-depth-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:05:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powered-stair-climbing-hand-truck-300-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:05:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pmcp-100-measuring-cup-w-red-blue-markings-1-qt-clear-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:05:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-outward-swing-door-w-hardware-24w-sand>: HTTP status code is not handled or not allowed
2026-01-10 20:05:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-two-piece-industry-standard-clamping-couplings-w-keyway-climax-2miscc-12-12skw>: HTTP status code is not handled or not allowed
2026-01-10 20:05:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-laminate-outward-swing-door-w-hardware-26w-khaki-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:05:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patriot-fully-framed-duty-locker-w-4-half-shelves-24wx24dx90h-blue-all-welded>: HTTP status code is not handled or not allowed
2026-01-10 20:05:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patriot-fully-framed-duty-locker-24wx24dx90h-gray-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:05:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/equipment-stand-w-adjustable-undershelf-24-x-30-24-high-ss-top-galvanized-legs-undershelf>: HTTP status code is not handled or not allowed
2026-01-10 20:05:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-set-screw-collar-climax-mc-13>: HTTP status code is not handled or not allowed
2026-01-10 20:05:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patriot-fully-framed-gear-locker-24wx24dx72h-gray-all-welded>: HTTP status code is not handled or not allowed
2026-01-10 20:05:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-x-24-black-mailing-tubes-with-caps-case>: HTTP status code is not handled or not allowed
2026-01-10 20:05:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-shop-desk-with-pigeonhole-compartment-riser-34-1-2-w-x-30-d-x-38-h-flat-surface-black>: HTTP status code is not handled or not allowed
2026-01-10 20:05:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stretch-wrap-film-for-hand-dispenser-blown-120-gauge-15w-x-1000l-clear-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 20:05:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qf-reducer-10-8-10-dia-304-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:05:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergodyne-proflex-4005-single-strap-wrist-brace-support-left-xl-black>: HTTP status code is not handled or not allowed
2026-01-10 20:05:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qf-reducer-6-4-6-dia-galvanized-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:05:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x-18-white-mailing-tubes-with-caps-case>: HTTP status code is not handled or not allowed
2026-01-10 20:05:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sc-6r-round-wire-skimmer-6d>: HTTP status code is not handled or not allowed
2026-01-10 20:05:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/patriot-fully-framed-ta-50-locker-wlouver-doorexpanded-side-36x24x78blunassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:05:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-kitchen-100-silicone-sealant-9-8-oz-white-7079808656>: HTTP status code is not handled or not allowed
2026-01-10 20:05:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wkcs-14-wok-cover-13-3-4-d-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:05:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-12-x-6-white-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:05:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/latex-all-purpose-wood-filler-32-oz-natural-7079800543>: HTTP status code is not handled or not allowed
2026-01-10 20:05:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/banding-stretch-wrap-with-reusable-dispenser-cast-150-gauge-2w-x-600l-clear-pack-of-24>: HTTP status code is not handled or not allowed
2026-01-10 20:05:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergodyne-skullerz-vordr-frameless-safety-glasses-clear-lens-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 20:05:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qf-hose-clamp-12-dia-304-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:05:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-topline-speed-burnish-pad-3200-20-in-5-case>: HTTP status code is not handled or not allowed
2026-01-10 20:05:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/step-up-clamp-on-adaptor-sua-series-climax-sua-125>: HTTP status code is not handled or not allowed
2026-01-10 20:05:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cbst-1824-cutting-board-set-18l-24w-1-2h-assorted-colors>: HTTP status code is not handled or not allowed
2026-01-10 20:05:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/advanced-exterior-sealant-10-1-oz-brown-7079818217>: HTTP status code is not handled or not allowed
2026-01-10 20:05:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wsecurity-bxfootlockervented24x18x72rdall-welded>: HTTP status code is not handled or not allowed
2026-01-10 20:05:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sg-58bmd-af-helium-15-safety-glasses-metal-detectable-blue-lens->: HTTP status code is not handled or not allowed
2026-01-10 20:05:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-couplings-recessed-screw-w-keyway-cc-series-climax-2cc-100-100-kw>: HTTP status code is not handled or not allowed
2026-01-10 20:05:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-star153-anti-fatigue-mat-1116-thick-4w-x-75l-blackyellow>: HTTP status code is not handled or not allowed
2026-01-10 20:05:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rigid-coupling-4-set-screws-2-90-rc4h-series-climax-rc-062-skw4h90>: HTTP status code is not handled or not allowed
2026-01-10 20:05:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-star153-anti-fatigue-mat-1116-thick-3w-x-5l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:05:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx-500c-0-5-rx-500-magnifier-safety-glasses-0-5-magnifier-clear-lens>: HTTP status code is not handled or not allowed
2026-01-10 20:05:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alrk-20-cv-cover-for-alrk-20-and-alrk-20bk>: HTTP status code is not handled or not allowed
2026-01-10 20:05:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/132c-ice-logger-boot-regular-tan-11>: HTTP status code is not handled or not allowed
2026-01-10 20:05:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2071r-reinforced-stainless-steel-fork>: HTTP status code is not handled or not allowed
2026-01-10 20:05:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-sided-shelf-trucks-2-lipped-shelves-24-60-6-poly-wheels>: HTTP status code is not handled or not allowed
2026-01-10 20:05:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-fixed-shade-12-welding-lens>: HTTP status code is not handled or not allowed
2026-01-10 20:05:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-grate-guard-high-flow-no-overflows-18l-x-36w-x-4h>: HTTP status code is not handled or not allowed
2026-01-10 20:05:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0016-03-winston-dinner-spoon>: HTTP status code is not handled or not allowed
2026-01-10 20:05:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-frame-sheet-panel-truck-back-shelf-storage-24-48-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:05:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-24wx24dx72h-red-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:05:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergodyne-proflex-7002-eco-recycled-pu-coated-gloves-l-green-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:05:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0030-18-shangarila-table-knife>: HTTP status code is not handled or not allowed
2026-01-10 20:05:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergodyne-proflex-7002-eco-recycled-pu-coated-gloves-2xl-green-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:05:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-climax-1c-012-z>: HTTP status code is not handled or not allowed
2026-01-10 20:05:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-t100-peel-off-lens-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:05:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/raised-platform-bo-trucks-lower-shelf-3-mesh-sides-18-32-poly-wheels>: HTTP status code is not handled or not allowed
2026-01-10 20:05:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0031-05-peacock-dinner-fork>: HTTP status code is not handled or not allowed
2026-01-10 20:05:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/albp-1218-aluminum-bake-pan-w-drop-hand>: HTTP status code is not handled or not allowed
2026-01-10 20:05:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-sar-breathing-tube-w-16-519-adapter>: HTTP status code is not handled or not allowed
2026-01-10 20:05:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/97603-s-connect-all-strap-small>: HTTP status code is not handled or not allowed
2026-01-10 20:05:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelate-silver-epoxy-wire-shelf-42x18>: HTTP status code is not handled or not allowed
2026-01-10 20:05:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-24wx18dx72h-red-all-welded>: HTTP status code is not handled or not allowed
2026-01-10 20:05:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/asp-1c-cover-for-asp-1>: HTTP status code is not handled or not allowed
2026-01-10 20:05:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slimline-rectangular-trash-can-lid-with-can-document-cutout-1623-gal-cap-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:05:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-door-cell-phone-locker-cp12-091572-dbk4-wide-whasp36w-x-15d-x-82-34h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:05:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-1254rvs-with-3-axis-acu-rite-g-2-millpower-cnc>: HTTP status code is not handled or not allowed
2026-01-10 20:05:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-z-brite-wire-shelf-18x54>: HTTP status code is not handled or not allowed
2026-01-10 20:05:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-regulator-body>: HTTP status code is not handled or not allowed
2026-01-10 20:05:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-door-cell-phone-locker-cp12-091572-abk1-wide-whasp9w-x-15d-x-82-34h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:05:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vanguard-series-gas-engine-horizontal-shaft-recoil-start-6-12-hp>: HTTP status code is not handled or not allowed
2026-01-10 20:05:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0021-01-continental-teaspoon>: HTTP status code is not handled or not allowed
2026-01-10 20:05:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-t-link-bump-cap-assembly>: HTTP status code is not handled or not allowed
2026-01-10 20:05:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-plastic-trash-container-garbage-can-32-gallon-bright-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:06:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fully-framed-stadium-locker-wshelf-footlocker-24wx18dx72h-red-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:06:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-z-brite-wire-shelf-21x36>: HTTP status code is not handled or not allowed
2026-01-10 20:06:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tb175-garden-gate-closer-white>: HTTP status code is not handled or not allowed
2026-01-10 20:06:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-21x42-nexelon>: HTTP status code is not handled or not allowed
2026-01-10 20:06:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-z-brite-wire-shelf-21x60>: HTTP status code is not handled or not allowed
2026-01-10 20:06:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelate-silver-epoxy-wire-shelf-24x24>: HTTP status code is not handled or not allowed
2026-01-10 20:06:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ghs-skull-crossbones-pictogram-label-2-x-2-500-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:06:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/azar-600612-blk-c-channel-12-w-x-1-4-d-x-6-h>: HTTP status code is not handled or not allowed
2026-01-10 20:06:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dxs2153-metric-standard-impact-socket-17mm-drive-black>: HTTP status code is not handled or not allowed
2026-01-10 20:06:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-nova-2000-nylon-cape-flow-control>: HTTP status code is not handled or not allowed
2026-01-10 20:06:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-nova-2000-leather-capeflow-control>: HTTP status code is not handled or not allowed
2026-01-10 20:06:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-coupling-climax-rc-125-s>: HTTP status code is not handled or not allowed
2026-01-10 20:06:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/max-lift-standard-scissor-lift-table-hand-operated-4000-lb-capacity-48l-x-48w>: HTTP status code is not handled or not allowed
2026-01-10 20:06:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ghs-information-pictogram-wall-chart-24-x-36>: HTTP status code is not handled or not allowed
2026-01-10 20:06:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-gx4-mounting-bracket>: HTTP status code is not handled or not allowed
2026-01-10 20:06:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0344r-iron-tuff-minus-50-suit-tall-navy-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:06:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17592 pages (at 100 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:06:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0344r-iron-tuff-minus-50-suit-tall-navy-large>: HTTP status code is not handled or not allowed
2026-01-10 20:06:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-climax-1c-037-z>: HTTP status code is not handled or not allowed
2026-01-10 20:06:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-wire-shelf-60x36>: HTTP status code is not handled or not allowed
2026-01-10 20:06:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/azar-700778-yel-two-sided-pegboard-floor-display-w-studio-base-17-w-x-17-d-x-60-h>: HTTP status code is not handled or not allowed
2026-01-10 20:06:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-profile-papr-hood-optimair-tl-20-pack-white>: HTTP status code is not handled or not allowed
2026-01-10 20:06:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-coupling-climax-rc-137>: HTTP status code is not handled or not allowed
2026-01-10 20:06:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0381r-iron-tuff-minus-50-suit-short-navy-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:06:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-one-piece-clamping-collar-climax-m1c-42>: HTTP status code is not handled or not allowed
2026-01-10 20:06:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0381r-iron-tuff-minus-50-suit-short-sage-large>: HTTP status code is not handled or not allowed
2026-01-10 20:06:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/22-meat-grinder-1-1-2-hp>: HTTP status code is not handled or not allowed
2026-01-10 20:06:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/913-washdowncompressed-air-hose-reel-spring-rewind-290-psi-12-id-x-65l>: HTTP status code is not handled or not allowed
2026-01-10 20:06:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0033-11-oxford-table-fork>: HTTP status code is not handled or not allowed
2026-01-10 20:06:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-nova-2000-inner-bib>: HTTP status code is not handled or not allowed
2026-01-10 20:06:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/azar-255010-stackable-letter-trays-3-5-8-w-x-1-1-2-d-x-2-h>: HTTP status code is not handled or not allowed
2026-01-10 20:06:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0490-insulated-softshell-jacket-regular-black-charcoal-large>: HTTP status code is not handled or not allowed
2026-01-10 20:06:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-two-piece-clamping-collar-climax-m2c-06>: HTTP status code is not handled or not allowed
2026-01-10 20:06:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bw-dk8-carving-knife>: HTTP status code is not handled or not allowed
2026-01-10 20:06:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-ladder-back-metal-restaurant-barstool-walnut-wood-seat>: HTTP status code is not handled or not allowed
2026-01-10 20:06:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bash-sledge-hammer-6-lb-head-36l-unbreakable-steel-core-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:06:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bash-soft-face-sledge-hammer-6-lb-head-36l-unbreakable-steel-core-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:06:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerquad153-atex-vacuum-kit-with-2-inlet-30-gallon-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:06:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/preference-white-high-capacity-roll-towel-1000ft-roll-6-rolls-case-26100>: HTTP status code is not handled or not allowed
2026-01-10 20:06:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bash-brass-sledge-hammer-25-lb-head-12-steel-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:06:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0361-iron-tuff-winter-seal-jacket-regular-navy-small>: HTTP status code is not handled or not allowed
2026-01-10 20:06:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dxs2153-metric-standard-impact-socket-32mm-drive-black>: HTTP status code is not handled or not allowed
2026-01-10 20:06:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0358r-iron-tuff-siberian-jacket-regular-sage-small>: HTTP status code is not handled or not allowed
2026-01-10 20:06:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/azar-700775-clr-two-sided-pegboard-floor-display-w-adj-studio-base-17-w-x-17-d-x-70-h>: HTTP status code is not handled or not allowed
2026-01-10 20:06:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graphic-signs-danger-hard-hat-area-plastic-10-w-x-14-h>: HTTP status code is not handled or not allowed
2026-01-10 20:06:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-z3-ultra-magnifying-lens-1-5>: HTTP status code is not handled or not allowed
2026-01-10 20:06:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maxicut-ultra-micro-foam-nitrile-coated-palm-fingers-gloves-ansi-a6-m-black-6-dozencase>: HTTP status code is not handled or not allowed
2026-01-10 20:06:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/azar-700913-bowl-for-pegboard-slatwall-12-w-x-13-1-4-d-x-7-1-2-h>: HTTP status code is not handled or not allowed
2026-01-10 20:06:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-z4-side-window-blockers-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:06:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bar-height-breakroom-table-72-lx36-wx42-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:06:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcp-30-malt-cup-30-oz-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:06:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-z3-hard-hat-adapter-clips>: HTTP status code is not handled or not allowed
2026-01-10 20:06:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0358r-iron-tuff-siberian-jacket-tall-navy-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:06:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-x-48-corrugated-sheets>: HTTP status code is not handled or not allowed
2026-01-10 20:06:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-087-dt>: HTTP status code is not handled or not allowed
2026-01-10 20:06:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-px5-belt-and-support-bracket>: HTTP status code is not handled or not allowed
2026-01-10 20:06:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-replacement-pad-driver-18-floor-scrubber>: HTTP status code is not handled or not allowed
2026-01-10 20:06:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-storage-cabinet-36x18x72-black>: HTTP status code is not handled or not allowed
2026-01-10 20:06:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-scrub-brush-20-floor-machine>: HTTP status code is not handled or not allowed
2026-01-10 20:06:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pf-32-funnel-32d>: HTTP status code is not handled or not allowed
2026-01-10 20:06:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0534-cooler-wear-frock-liner-regular-navy-5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:06:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dxs2153-metric-standard-impact-socket-24mm-drive-black>: HTTP status code is not handled or not allowed
2026-01-10 20:06:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-recessed-screw-climax-h1c-262-s>: HTTP status code is not handled or not allowed
2026-01-10 20:06:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/msb-12-coarse-mesh-12-diameter-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:06:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-px5-spark-arrestor>: HTTP status code is not handled or not allowed
2026-01-10 20:06:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ivy-x-83644-pre-contact-barrier-gel-posion-oak-and-ivy-solution-towelette-300-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:06:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-z-link-ir-shade-5-safety-lens>: HTTP status code is not handled or not allowed
2026-01-10 20:06:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-storage-cabinet-36x24x72-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:06:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-inch-x-5-yards-self-adhesive-bandage-non-latex-dark-blue-pack-of-8>: HTTP status code is not handled or not allowed
2026-01-10 20:06:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/basic-active-shooter-trauma-essentials-supplies-refill-kit-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:06:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-way-adjustbale-ergonomic-chair-with-arms-black>: HTTP status code is not handled or not allowed
2026-01-10 20:06:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0486-hoodie-sweatshirt-regular-navy-large>: HTTP status code is not handled or not allowed
2026-01-10 20:06:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maxflow-ansi-life-vest-mesh-uscgtc-type-iii-m-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:06:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-015-s>: HTTP status code is not handled or not allowed
2026-01-10 20:06:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n24s-quick-disconnect-hose-adapter-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:06:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bstop4-08wm-bleed-stop-active-shooter-wall-mount-system-multi-use-multi-injury>: HTTP status code is not handled or not allowed
2026-01-10 20:06:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-double-wide-climax-d2c-025>: HTTP status code is not handled or not allowed
2026-01-10 20:06:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-2-wheel-trash-cart-w-casters-96-gallon-blue-acc96-00blu>: HTTP status code is not handled or not allowed
2026-01-10 20:06:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-person-heat-stress-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:06:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0317-insulator-mitt-gold-medium>: HTTP status code is not handled or not allowed
2026-01-10 20:06:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/accesory-kit-for-mega-brute-waste-collector-black-fg9w71l90000>: HTTP status code is not handled or not allowed
2026-01-10 20:06:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-30-esd-safety-edge-top-pedestal-workbench-w-8-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:06:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s90-500-20-hand-chain-hoist-5-ton-capacity-20-lift>: HTTP status code is not handled or not allowed
2026-01-10 20:06:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wpb-3-deluxe-bell-pitcher-3-qt-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:06:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wpb-3c-deluxe-bell-pitcher-w-ice-catcher-3-qt-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:06:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100-safety-orange-extension-cord-12awg-15a-125v-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:06:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-filters-for-hf13-filter-fans-ip55-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:06:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-z4-weld-visor-assembly>: HTTP status code is not handled or not allowed
2026-01-10 20:06:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glc-05185-pre-cleaned-clean-glass-screw-thread-sample-vials-1-dram-4ml-case-of-144>: HTTP status code is not handled or not allowed
2026-01-10 20:06:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-by-20-stage-package-24-inches-height-grey-carpet-black-shirred-pleat-skirting>: HTTP status code is not handled or not allowed
2026-01-10 20:06:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-inch-x-5-yards-self-adhesive-bandage-non-latex-yellow-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 20:06:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-treading-alloy-dies-1-1-4>: HTTP status code is not handled or not allowed
2026-01-10 20:06:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stretch-wrap-18-x-1500-dispenser-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:06:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-sjt-power-supply-replacement-cord-16awg-13a-125v-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:06:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chair-guard-for-sp488-pie-unit>: HTTP status code is not handled or not allowed
2026-01-10 20:06:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-inch-x-5-yards-self-adhesive-bandage-non-latex-yellow-pack-of-8>: HTTP status code is not handled or not allowed
2026-01-10 20:06:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/58-rectangular-picnic-table-polished-gray-limestone-top-red-quartzite-leg>: HTTP status code is not handled or not allowed
2026-01-10 20:06:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cantilever-rack-straight-arm-no-lip-2>: HTTP status code is not handled or not allowed
2026-01-10 20:06:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-commercial-concrete-bench-polished-white-top-red-quartzite-leg>: HTTP status code is not handled or not allowed
2026-01-10 20:07:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cantilever-rack-straight-arm-with-2-lip-34>: HTTP status code is not handled or not allowed
2026-01-10 20:07:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/svm-12-food-mill-5-qt-5-graters>: HTTP status code is not handled or not allowed
2026-01-10 20:07:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-threaded-clamping-collar-climax-istc-112-12-s>: HTTP status code is not handled or not allowed
2026-01-10 20:07:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-inch-x-5-yards-self-adhesive-bandage-non-latex-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:07:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-outdoor-steel-picnic-bench-with-backrest-perforated-metal-black>: HTTP status code is not handled or not allowed
2026-01-10 20:07:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1450160-airflow-conveyor-chain-af-24d>: HTTP status code is not handled or not allowed
2026-01-10 20:07:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-1146-mini-low-pressure-regulator-14-npt-250-psi-gauge-not-included>: HTTP status code is not handled or not allowed
2026-01-10 20:07:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-2-tier-wire-shelving-starter-unit-42-w-x-21-d-x-34-h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twpo-7-offset-spatulas-7-3-4l-blade-white-polypropylene-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:07:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modesto-32-in-tall-planter-white>: HTTP status code is not handled or not allowed
2026-01-10 20:07:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-strip-no-adhesive-70a-116-thick-x-6-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:07:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-3-tier-wire-shelving-starter-unit-42-w-x-24-d-x-34-h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ift-1d-dolly-w-cargo-strap-for-ift-1-polypropylene-green>: HTTP status code is not handled or not allowed
2026-01-10 20:07:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-2-tier-wire-shelving-starter-unit-54-w-x-18-d-x-34-h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-cabinet-10>: HTTP status code is not handled or not allowed
2026-01-10 20:07:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-109-square-shakers-w-mushroom-tops>: HTTP status code is not handled or not allowed
2026-01-10 20:07:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17690 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:07:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-round-cranium-led-flush-mount-light-30w-120v-to-277v-3000k-white>: HTTP status code is not handled or not allowed
2026-01-10 20:07:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wpm-12-wooden-pepper-mill>: HTTP status code is not handled or not allowed
2026-01-10 20:07:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c57rb-osha-sign-caution-slippery-when-wet-10-x-14-yellowblack>: HTTP status code is not handled or not allowed
2026-01-10 20:07:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-tier-shelving-starter-unit-solid-galvanized-steel-42w-x-18d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23169-cut-off-wheel-type-1-saitech-4-inch-x-035-inch-x-3-8-inch-ceramic-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 20:07:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-bb-12010h-nc-heavy-duty-hydraulic-box-pan-brake-10l-5-hp-3ph-220v>: HTTP status code is not handled or not allowed
2026-01-10 20:07:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d84rb-osha-sign-danger-propane-gas-10-x-14-whiteredblack>: HTTP status code is not handled or not allowed
2026-01-10 20:07:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-no-adhesive-60a-12-thick-x-36-wide-x-4-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:07:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-rdb-150-as-hydraulic-rotary-draw-tube-pipe-bender-with-auto-stop-110v>: HTTP status code is not handled or not allowed
2026-01-10 20:07:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-electric-blower-9504-8-dia-1-3hp1066-cfm-cage-enclosed>: HTTP status code is not handled or not allowed
2026-01-10 20:07:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bc12914-universal-console-box>: HTTP status code is not handled or not allowed
2026-01-10 20:07:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-tier-shelving-starter-unit-solid-galvanized-steel-42w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23181-cut-off-wheel-type-1-saitech-6-inch-x-045-inch-x-5-8-inch-ceramic-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 20:07:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-2-tier-wire-shelving-starter-unit-36-w-x-18-d-x-34-h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1315310-fisher-plow-harness-49317>: HTTP status code is not handled or not allowed
2026-01-10 20:07:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mstf-6d-medium-double-mesh-6-1-4-diameter-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:07:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coper-notcher-for-2013-ironworkers-older-100t-ironworkers>: HTTP status code is not handled or not allowed
2026-01-10 20:07:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-3-4-x-1-7-8-3-manila-pre-strung-tag-2>: HTTP status code is not handled or not allowed
2026-01-10 20:07:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-sheet-no-adhesive-60a-38-thick-x-36-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:07:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-tier-shelving-starter-unit-solid-galvanized-steel-42w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/241-punch-assembly-for-50t-55t-60t-ironworkers-2013-older>: HTTP status code is not handled or not allowed
2026-01-10 20:07:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-wjt-sb422uw-16-square-block-11-34l-x-7-34w-x-4h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oversize-round-punch-die-set-1>: HTTP status code is not handled or not allowed
2026-01-10 20:07:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mpd-48-mixing-paddle>: HTTP status code is not handled or not allowed
2026-01-10 20:07:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deck-support-36-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:07:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrosion-resistant-set-screw-collar-cr-climax-crc-025-s>: HTTP status code is not handled or not allowed
2026-01-10 20:07:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kcp-15-15-cheese-knife-double-pp-handles>: HTTP status code is not handled or not allowed
2026-01-10 20:07:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pdt-15-decanter-w-lid-51-oz-polycarbonate>: HTTP status code is not handled or not allowed
2026-01-10 20:07:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pecc-m-square-cover-for-pesc-6-8-and-pcsc-6c-8c-white>: HTTP status code is not handled or not allowed
2026-01-10 20:07:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-rubber-strip-with-high-temp-adhesive-75a-116-thick-x-1-wide-x-3-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:07:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-tier-shelving-starter-unit-solid-galvanized-steel-42w-x-24d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-recessed-screw-climax-h2c-137-s>: HTTP status code is not handled or not allowed
2026-01-10 20:07:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-threaded-clamping-collar-climax-istc-087-14-s>: HTTP status code is not handled or not allowed
2026-01-10 20:07:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-tier-shelving-starter-unit-solid-galvanized-steel-54w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:07:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-mss-14h-ce-hydraulically-operated-shrinker-stretcher-220v>: HTTP status code is not handled or not allowed
2026-01-10 20:07:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mesh-task-chair-fabric-seat-white-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:07:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-rubber-roll-no-adhesive-75a-116-thick-x-36-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:07:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-four-drawer-hardware-kit-for-rubbermaidtrademaster-carts>: HTTP status code is not handled or not allowed
2026-01-10 20:07:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-industry-standard-clamping-couplings-climax-iscc-087-087>: HTTP status code is not handled or not allowed
2026-01-10 20:07:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-rubber-roll-no-adhesive-75a-132-thick-x-36-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:07:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-replacement-liner-16-bushel-green-2>: HTTP status code is not handled or not allowed
2026-01-10 20:07:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0007-03-regency-dinner-spoon>: HTTP status code is not handled or not allowed
2026-01-10 20:07:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60511-sanding-belt-1a-x-2-inch-x-48-inch-100-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 20:07:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-47-welding-positioner-6600-lb-capacity-3-ph-440v>: HTTP status code is not handled or not allowed
2026-01-10 20:07:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35069-psa-disc-4-inch-dia-180-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 20:07:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-punch-die-set-916>: HTTP status code is not handled or not allowed
2026-01-10 20:07:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-rubber-sheet-no-adhesive-75a-132-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:07:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-pocket-heavyweight-poly-portfolio-folder-white-25-set>: HTTP status code is not handled or not allowed
2026-01-10 20:07:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-piece-clamping-collar-double-wide-climax-d2c-100>: HTTP status code is not handled or not allowed
2026-01-10 20:07:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-spring-rewind-hose-reel-for-air-water-3-8-i-d-50-hose-300-psi>: HTTP status code is not handled or not allowed
2026-01-10 20:07:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-322an-alloy-hook-swivel-w-latch-22t-wll>: HTTP status code is not handled or not allowed
2026-01-10 20:07:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brady-universal-ball-valve-lockout-valve-lockout-red>: HTTP status code is not handled or not allowed
2026-01-10 20:07:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g100-chain-clevis-cradle-grab-hook-3-8-8800-lbs-wll-a-1338>: HTTP status code is not handled or not allowed
2026-01-10 20:07:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fiberglass-tote-lid-24-3-8x14-7-8-green>: HTTP status code is not handled or not allowed
2026-01-10 20:07:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-sheet-with-acrylic-adhesive-60a-18-thick-x-6-wide-x-6-long>: HTTP status code is not handled or not allowed
2026-01-10 20:07:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/37521-hook-and-loop-disc-5-inch-dia-320-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 20:07:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-one-piece-clamping-collar-climax-m1c-09-s>: HTTP status code is not handled or not allowed
2026-01-10 20:07:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-rewind-static-discharge-cable-reel-100-cable-capacity-less-cable>: HTTP status code is not handled or not allowed
2026-01-10 20:07:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fabricators-protractor>: HTTP status code is not handled or not allowed
2026-01-10 20:07:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-spring-rewind-hose-reel-for-fuel-34-i-d-25-hose-300-psi>: HTTP status code is not handled or not allowed
2026-01-10 20:07:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-rewind-static-discharge-cable-reel-75-stainless-steel-cable>: HTTP status code is not handled or not allowed
2026-01-10 20:07:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-with-acrylic-adhesive-50a-38-thick-x-36-w-x-10-ft-l>: HTTP status code is not handled or not allowed
2026-01-10 20:07:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-bv-6i-bench-vise-with-pipe-jaws-6-12-jaw-width-3-1316-throat-depth>: HTTP status code is not handled or not allowed
2026-01-10 20:07:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72340-encore-flap-disc-type-29-4-1-2-inch-x-5-8-inch-11-60-grit-zirconium>: HTTP status code is not handled or not allowed
2026-01-10 20:07:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-curtain-electric-heat-42-inch-with-ecm-motor-wing-e100-ec-480-240v-3ph>: HTTP status code is not handled or not allowed
2026-01-10 20:07:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zirconium-oxide-belt-2-x-48-40-grit-pack-of-3>: HTTP status code is not handled or not allowed
2026-01-10 20:07:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-racking-chair-black>: HTTP status code is not handled or not allowed
2026-01-10 20:07:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-429-galvanized-clip-fist-grip-3-16>: HTTP status code is not handled or not allowed
2026-01-10 20:07:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gauging-table-kit-for-25t-ironworker-july-2017-newer>: HTTP status code is not handled or not allowed
2026-01-10 20:07:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suit-hanger-rubber-white-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:07:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-piece-clamping-collar-recessed-screw-climax-h1c-056>: HTTP status code is not handled or not allowed
2026-01-10 20:07:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dolly-42-1-2x20-x-14-1-4-tote-green>: HTTP status code is not handled or not allowed
2026-01-10 20:07:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-piece-nested-oval-cotton-cording-baskets-sand>: HTTP status code is not handled or not allowed
2026-01-10 20:07:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-with-acrylic-adhesive-60a-18-thick-x-36-w-x-10-ft-l>: HTTP status code is not handled or not allowed
2026-01-10 20:07:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-row-national-rep-aluminum-bleacher-7-1-2-wide-single-footboard>: HTTP status code is not handled or not allowed
2026-01-10 20:07:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-piece-round-water-hyacinth-baskets-natural>: HTTP status code is not handled or not allowed
2026-01-10 20:07:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-no-adhesive-50a-116-thick-x-36-wide-x-8-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:07:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-collar-climax-c-006-bo>: HTTP status code is not handled or not allowed
2026-01-10 20:07:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lightweight-set-screw-collar-l-climax-lc-050>: HTTP status code is not handled or not allowed
2026-01-10 20:07:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-stacking-bin-11-x-18-x-10-black>: HTTP status code is not handled or not allowed
2026-01-10 20:07:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pebble-surface-mat-black-yellow-24x36>: HTTP status code is not handled or not allowed
2026-01-10 20:07:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-all-purpose-scale-7998-lb-x-002-lb>: HTTP status code is not handled or not allowed
2026-01-10 20:08:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-roll-with-acrylic-adhesive-70a-38-thick-x-36-w-x-10-ft-l>: HTTP status code is not handled or not allowed
2026-01-10 20:08:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jiw-45t-45-ton-ironworker>: HTTP status code is not handled or not allowed
2026-01-10 20:08:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-320cn-s-c-carbon-hook-eye-w-latch-15t-wll>: HTTP status code is not handled or not allowed
2026-01-10 20:08:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gn-184-countersunk-washers-steel-blackened-5-16-1-8-h-13-16-outside-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:08:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-1337-g100-chain-connecting-link-lok-a-loy-1-4-4300-lbs-wll>: HTTP status code is not handled or not allowed
2026-01-10 20:08:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/original-boat-hull-cleaner-gallon-bottle-4-case>: HTTP status code is not handled or not allowed
2026-01-10 20:08:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/economy-d-ring-vinyl-view-binder-4-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 20:08:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/din-580-lifting-eye-bolts-stainless-steel-shoulder-matte-m10-1-3-4-h-3-8-t-11-16-l>: HTTP status code is not handled or not allowed
2026-01-10 20:08:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-sheet-with-acrylic-adhesive-50a-12-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-264-pad-eye--1-1-2>: HTTP status code is not handled or not allowed
2026-01-10 20:08:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-505-sleeve-swage-1-1-4>: HTTP status code is not handled or not allowed
2026-01-10 20:08:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-4320-latch-kit-new-style-3t-carbon-5t-alloy-hook-2-31-l-x-0-83-w>: HTTP status code is not handled or not allowed
2026-01-10 20:08:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suede-finish-vinyl-round-ring-binder-3-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 20:08:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-320cn-s-c-carbon-hook-eye-w-latch-5t-wll>: HTTP status code is not handled or not allowed
2026-01-10 20:08:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-neoprene-rubber-sheet-no-adhesive-70a-116-thick-x-36-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17787 pages (at 97 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:08:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leeson-dc-controls-scr-series-pwm-series-nema-1-reversing-1ph-1-40-1-8hp-1-40-1-4hp-115-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:08:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leeson-3-phase-washguard-duty-motor-1-5hp-1800-145tc-tefc-230-460v-60hz-c-face>: HTTP status code is not handled or not allowed
2026-01-10 20:08:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerquad153-510-gallon-wire-cage-coalescing-filter-black>: HTTP status code is not handled or not allowed
2026-01-10 20:08:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gn-749-threaded-pipe-plugs-steel-zinc-plated-with-nbr-synthetic-rubber-seal-g-3-8>: HTTP status code is not handled or not allowed
2026-01-10 20:08:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/record-storage-rack-gray-96-wx-48-d-x-60-h-with-polyethylene-file-boxes>: HTTP status code is not handled or not allowed
2026-01-10 20:08:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-cart-poly-green-24l-x-18w-x-40h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:08:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cortech-usa-106484br-sentinel-chair-brown-fr-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:08:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gn-1804-1-slotted-spanner-lock-nuts-steel-with-polyamide-insert-zinc-plated-m20-x-1>: HTTP status code is not handled or not allowed
2026-01-10 20:08:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wn-751-clevis-fork-joints-steel-w-snap-on-spring-pin-zinc-pltd-3-8-x-24-2-3-8-oal>: HTTP status code is not handled or not allowed
2026-01-10 20:08:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-sided-bulk-truck-slat-type-sides-30-x-48-polyurethane-wheels>: HTTP status code is not handled or not allowed
2026-01-10 20:08:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wn-751-clevis-fork-joints-steel-w-snap-on-spring-pin-zinc-pltd-1-4-x-28-1-7-16-oal>: HTTP status code is not handled or not allowed
2026-01-10 20:08:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wn-751-clevis-fork-joints-steel-w-snap-on-spring-pin-zinc-pltd-1-4-x-28l-1-7-16-oal>: HTTP status code is not handled or not allowed
2026-01-10 20:08:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-frame-sheet-panel-truck-24-x-36>: HTTP status code is not handled or not allowed
2026-01-10 20:08:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-with-high-temp-adhesive-50a-116-thick-x-36-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n-6505-closet-door-roller-back-12-inch-offset-78-inch-nylon-wheelpack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:08:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-wheel-belt-grinder-2-w-x-48-l-single-phase-110v-bg-248-2>: HTTP status code is not handled or not allowed
2026-01-10 20:08:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l100-1000wo-20-hand-chain-hoist-with-overload-protection-10-ton-capacity-20-lift>: HTTP status code is not handled or not allowed
2026-01-10 20:08:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-locker-single-tier-12x18x60-1-door-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:08:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15949-1-14mm-long-arm-hex-end-l-wrench>: HTTP status code is not handled or not allowed
2026-01-10 20:08:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-locker-single-tier-12x18x60-3-door-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:08:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leeson-single-phase-general-purpose-motor-50hz-3-4hp-55kw-1425rpm-56-ip54manual-1-0sf-rigid>: HTTP status code is not handled or not allowed
2026-01-10 20:08:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerquad153-vacuum-generating-engine-blackmetal>: HTTP status code is not handled or not allowed
2026-01-10 20:08:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-wheel-single-speed-belt-grinder-2-w-x-48-l-single-phase-115v-bg-248s>: HTTP status code is not handled or not allowed
2026-01-10 20:08:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-locker-single-tier-15x18x72-3-door-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:08:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-0-hp-pistol-grip-non-reversible-drill-6000-rpm-3-8-inch-chuck>: HTTP status code is not handled or not allowed
2026-01-10 20:08:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-locker-single-tier-15x18x72-3-door-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:08:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wagon-truck-flush-deck-30-x-40-mold-on-rubber-wheels>: HTTP status code is not handled or not allowed
2026-01-10 20:08:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-solid-tarp-7-ft-x-15-ft-3011352>: HTTP status code is not handled or not allowed
2026-01-10 20:08:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-shelf-24-x-48>: HTTP status code is not handled or not allowed
2026-01-10 20:08:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manually-operated-box-and-pan-finger-brake-2-l-16-gauge>: HTTP status code is not handled or not allowed
2026-01-10 20:08:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-base-12-d-x-6-h-tan-pair-le-right>: HTTP status code is not handled or not allowed
2026-01-10 20:08:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stinger-spillpal-foam-wall-spill-containment-berm-50l-x-25w-x-4h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:08:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leeson-single-phase-explosion-proof-motor-1-3hp-3450rpm-56-epfc-60hz-automatic-1-0sf-rigid>: HTTP status code is not handled or not allowed
2026-01-10 20:08:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-sheet-no-adhesive-60a-132-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wow-ballpoint-retractable-pen-blue-ink-medium-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:08:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/belt-grinder-6-w-x-79-l-3-phase-220v-bg-679>: HTTP status code is not handled or not allowed
2026-01-10 20:08:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-50a-12-thick-x-36-wide-x-9-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teardrop-pallet-rack-add-on-144w-x-42d-x-120h-7110-lbs-shelf-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:08:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-50a-12-thick-x-36-wide-x-7-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tackboard-black-fabric-for-71-hutch-black-fabric>: HTTP status code is not handled or not allowed
2026-01-10 20:08:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-in-1-combination-shear-brake-and-roll-30-bed-width-20-gauge>: HTTP status code is not handled or not allowed
2026-01-10 20:08:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rock-small-double-coat-hook-satin-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:08:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-shelf-wagon-truck-24-x-48-10-inch-rubber-wheels>: HTTP status code is not handled or not allowed
2026-01-10 20:08:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tyvek-400-sfr-coverall-elastic-wrists--ankle-serged-seams-6xl-white-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 20:08:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silver-doors-for-sl36ho-and-sl36wc>: HTTP status code is not handled or not allowed
2026-01-10 20:08:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipe-stake-truck-24-x-36-polyurethane-wheels>: HTTP status code is not handled or not allowed
2026-01-10 20:08:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cnc-plasma-cutting-table-single-phase-220v-pt-48ah-w>: HTTP status code is not handled or not allowed
2026-01-10 20:08:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prime-small-moving-boxes-24l-x-12w-x-10h-kraft-blue-8-ctn>: HTTP status code is not handled or not allowed
2026-01-10 20:08:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leeson-single-phase-general-purpose-motor-1-2hp-3450rpm-48-tefc-115-208-230v-60hz-round>: HTTP status code is not handled or not allowed
2026-01-10 20:08:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-strip-no-adhesive-70a-332-thick-x-2-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/qualifier-plus-iiix-advanced-residential-real-estate-finance>: HTTP status code is not handled or not allowed
2026-01-10 20:08:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/instrument-cart-w-hand-guard-flush-shelves-non-slip-vinyl-surface-24-x-48>: HTTP status code is not handled or not allowed
2026-01-10 20:08:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/313-carton-sealing-tape-2-x-55-yds-25-mil-clear-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:08:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wagon-truck-steel-deck-8-x-250-rubber-wheel>: HTTP status code is not handled or not allowed
2026-01-10 20:08:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foot-operated-corner-notcher-16-gauge-mild-steel-capacity-3-l-blade>: HTTP status code is not handled or not allowed
2026-01-10 20:08:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wagon-truck-lip-deck-30-x-40-pneumatic-wheels-3000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:08:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caster-steer-trailer-30-x-60>: HTTP status code is not handled or not allowed
2026-01-10 20:08:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-strip-no-adhesive-50a-116-thick-x-6-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-70a-332-thick-x-36-wide-x-4-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-shelf-truck-4-flush-shelves-24-x-36-w-writing-shelf-document-pocket>: HTTP status code is not handled or not allowed
2026-01-10 20:08:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-garment-mailers-28-34l-x-16w-x-5h-kraft-25pack>: HTTP status code is not handled or not allowed
2026-01-10 20:08:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/291-acrylic-carton-sealing-tape-2-x-110-yds-26-mil-tan-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:08:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/94-l-inside-corner-trim-in-rain-cloud-5-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:08:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1000-hot-melt-tape-3-x-55-yds-3-mil-clear-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:08:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wagon-truck-lip-deck-36-x-60-pneumatic-wheels-3000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:08:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-sheet-with-acrylic-adhesive-50a-12-thick-x-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:08:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-duo-dri-foam-rubber-heavy-duty-floor-squeegee-2724>: HTTP status code is not handled or not allowed
2026-01-10 20:08:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swb7-digital-water-bath-7-liter-capacity-115v>: HTTP status code is not handled or not allowed
2026-01-10 20:08:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v70632-job-sight-class-2-vest-fluorescent-lime-polyester-mesh-4xl5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:08:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iteq235-circuit-breaker-type-qp-2-pole-35a>: HTTP status code is not handled or not allowed
2026-01-10 20:08:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/i-beam-trolley-4-000-pound-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:08:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mb920b-dipped-neoprene-snugleg-boots-brick-redbrown-size-11>: HTTP status code is not handled or not allowed
2026-01-10 20:08:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-chain-hoist-10-foot-li-10-000-pound-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:08:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/94-l-j-trim-in-natural-oak-5-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:08:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-general-security-brass-solid-body-padlocks-no-4140>: HTTP status code is not handled or not allowed
2026-01-10 20:08:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carton-sealing-tape-keep-refrigerated-3-x-110-yds-22-mil-redwhite-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:08:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-upper-shelf-dividers-pack-of-6-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:08:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/110-cup-coffee-urn-120v-1500w-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:08:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-high-security-steel-weather-resistant-covered-laminated-padlocks-no-6127lh>: HTTP status code is not handled or not allowed
2026-01-10 20:08:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colored-carton-sealing-tape-2-x-55-yds-22-mil-yellow-18pack>: HTTP status code is not handled or not allowed
2026-01-10 20:08:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-high-security-steel-solid-body-padlocks-no-7040ka>: HTTP status code is not handled or not allowed
2026-01-10 20:08:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x-9-in-ground-post-mounted-safety-barrier-net-kit-orange-net-yellow-posts>: HTTP status code is not handled or not allowed
2026-01-10 20:08:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss3236-stainless-steel-36-tooth-1-125-pitch-spur-gear>: HTTP status code is not handled or not allowed
2026-01-10 20:09:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/900-hot-melt-tape-2-x-110-yds-25-mil-clear-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:09:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-shelving-closed-shelving-36x12x75-14>: HTTP status code is not handled or not allowed
2026-01-10 20:09:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skx1-78-c45-steel-black-oxide-quick-detach-bushing-1-78-inch-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:09:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-part-carbonless-stub-style-inv-tag-pre-wired-3500-3999-8-6-14lx3-18w-500pk>: HTTP status code is not handled or not allowed
2026-01-10 20:09:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-shelving-open-shelving-36x12x39-24>: HTTP status code is not handled or not allowed
2026-01-10 20:09:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x25-cargo-net-roll-1-polypropylene-webbing-5-mesh-size-700lb-tensile-strength>: HTTP status code is not handled or not allowed
2026-01-10 20:09:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-x40-personnel-fall-safety-net-bordered-5000lb-min-test-synthetic-rope-black>: HTTP status code is not handled or not allowed
2026-01-10 20:09:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-strip-with-acrylic-adhesive-70a-18-thick-x-6-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:09:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/justrite-aerosol-can-flammable-safety-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 20:09:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hytrol-15-inch-w-skatewheel-curve-15-inch-oaw-90-degree>: HTTP status code is not handled or not allowed
2026-01-10 20:09:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluidity-03f-hung-diaphragm-solenoid-valve-2-2-nc-nbr-1-nptf-25-mm-110v-ac-31va>: HTTP status code is not handled or not allowed
2026-01-10 20:09:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carton-sealing-tape-packing-list-enclosed-2-x-110-yds-redwhite-18pack>: HTTP status code is not handled or not allowed
2026-01-10 20:09:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-electric-horizontal-unit-heater-10kw-480v>: HTTP status code is not handled or not allowed
2026-01-10 20:09:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colored-carton-sealing-tape-3-x-55-yds-22-mil-white-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:09:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hytrol-10-ft-42-inch-w-1-9-inch-dia-galvanized-rollers-39-inch-between-rail-3-inch-rollers-centers>: HTTP status code is not handled or not allowed
2026-01-10 20:09:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17885 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:09:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hytrol-5-ft-24-inch-w-1-9-inch-dia-galvanized-rollers-21-inch-between-rail-4-5-inch-rollers-centers>: HTTP status code is not handled or not allowed
2026-01-10 20:09:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permaloc-wire-rope-sling-1-2-in-x8-ft-eye-to-eye>: HTTP status code is not handled or not allowed
2026-01-10 20:09:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pinnacle-plus-90-series-rubber-wall-base-1-coil-4-in-x-125-in-x-60-ft-black-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:09:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluidity-03f-hung-diaphragm-solenoid-valve-2-2-nc-fkm-seal-1-2-nptf-12-mm-24v-dc>: HTTP status code is not handled or not allowed
2026-01-10 20:09:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluidity-02f-direct-acting-solenoid-valve-3-2-nc-nbr-seal-3-8-nptf-3-mm-12v-dc>: HTTP status code is not handled or not allowed
2026-01-10 20:09:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-spanish-led-sign-abierto-open-16-125w-6-75h>: HTTP status code is not handled or not allowed
2026-01-10 20:09:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-locker-double-tier-12x12x36-6-door-assembled-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:09:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-320-nipple-1-4-female-npt-european-interchange>: HTTP status code is not handled or not allowed
2026-01-10 20:09:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-single-tab-white-helvetica-2-letters-double-set>: HTTP status code is not handled or not allowed
2026-01-10 20:09:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-60a-116-thick-x-36-wide-x-6-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:09:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-framed-letter-board-message-center-12w-18h>: HTTP status code is not handled or not allowed
2026-01-10 20:09:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-part-carbonless-inventory-tag-pre-wired-0500-0999-8-6-14l-x-3-18w-500pack>: HTTP status code is not handled or not allowed
2026-01-10 20:09:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-raised-circular-stair-tread-square-nose-12063-x-54-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:09:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-raised-circular-stair-tread-square-nose-12063-x-54-lunar-dust>: HTTP status code is not handled or not allowed
2026-01-10 20:09:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluidity-03f-hung-diaphragm-solenoid-valve-2-2-nc-epdm-seal-1-nptf-25-mm-12v-dc>: HTTP status code is not handled or not allowed
2026-01-10 20:09:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o24122-icon-snap-fly-front-overall-fluorescent-lime-md>: HTTP status code is not handled or not allowed
2026-01-10 20:09:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-310-nipple-1-4-female-npt-industrial-interchange-1-4>: HTTP status code is not handled or not allowed
2026-01-10 20:09:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o53129-comfortbrite-snap-fly-front-overall-fluorescent-orange-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:09:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-60a-12-thick-x-36-wide-x-8-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:09:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-no-adhesive-60a-18-thick-x-36-wide-x-7-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:09:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-tag-pre-strung-6-5-14l-x-2-58w-fluorescent-pink-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:09:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24xl037-6fa4-aluminum-clear-anodized-24-tooth-1-528-pitch-finished-bore-pulley>: HTTP status code is not handled or not allowed
2026-01-10 20:09:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21t5-18-2-aluminum-18-tooth-plain-bore-timing-belt-pulley>: HTTP status code is not handled or not allowed
2026-01-10 20:09:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-ketron-peek-sheet-q-0-500-thick-x-24-w-x-24-l>: HTTP status code is not handled or not allowed
2026-01-10 20:09:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-ss-304304l-38-14-hex-bushing-npt-male-female>: HTTP status code is not handled or not allowed
2026-01-10 20:09:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-roll-no-adhesive-40a-12-thick-x-36-wide-x-7-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:09:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-low-circular-profile-square-nose-125-x-48-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 20:09:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-ss-304304l-1-12x-1-14-hex-bushing-npt-male-female>: HTTP status code is not handled or not allowed
2026-01-10 20:09:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-tag-pre-strung-4-4-14l-x-2-18w-yellow-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:09:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o56007-durascrim-plain-front-overall-yellow-lg>: HTTP status code is not handled or not allowed
2026-01-10 20:09:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merit-red-brass-seamless-standard-1-12-Close-npt-male>: HTTP status code is not handled or not allowed
2026-01-10 20:09:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/advantage-pro-max-pallet-jack-scale-truck-27w-x-62l-4400-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:09:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j41108-safetyflex-storm-fly-front-hooded-jacket-green-md>: HTTP status code is not handled or not allowed
2026-01-10 20:09:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mail-box-drop-safe-b5325dm-sr2sg40-26l-x-25w-x-53h-electronic-lock-936-cu-ft-black>: HTTP status code is not handled or not allowed
2026-01-10 20:09:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-fda-silicone-rubber-sheet-no-adhesive-60a-132-thick-x-36-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:09:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-delrin-homopolymer-sheet-1-000-thick-x-24-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 20:09:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-shelf-steel-shelving-with-30-akro-mils-shelf-bins-2>: HTTP status code is not handled or not allowed
2026-01-10 20:09:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-workbench-stool-mid-back-black>: HTTP status code is not handled or not allowed
2026-01-10 20:09:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silencer-gp-band-saw-blade-1-1-4-inch-w-042-thick-gauge-5-8-tpi-303-539167>: HTTP status code is not handled or not allowed
2026-01-10 20:09:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silencer-plus-band-saw-blade-1-1-4-inch-w-042-thick-gauge-4-6-tpi-333-346167>: HTTP status code is not handled or not allowed
2026-01-10 20:09:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-in-super-air-knife-shim-set-alum>: HTTP status code is not handled or not allowed
2026-01-10 20:09:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-uhmw-strip-skived-0-031-thick-x-24-000-w-x-50-l>: HTTP status code is not handled or not allowed
2026-01-10 20:09:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-4-in-line-vac-only-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:09:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-x-2-semi-steel-caster-kit-d-ck4-sc8-2-for-hopper-4800-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:09:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-in-line-vac-only-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:09:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4x5-8-t29-z3-reg-80-gritflap-disc>: HTTP status code is not handled or not allowed
2026-01-10 20:09:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-1-2x7-8-zs-60-t29-xl-stainless-flap-disc>: HTTP status code is not handled or not allowed
2026-01-10 20:09:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1724s05-osha-stairway-24width-5-stairs>: HTTP status code is not handled or not allowed
2026-01-10 20:09:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-clear-plastic-box-5-gallon-18x12x9>: HTTP status code is not handled or not allowed
2026-01-10 20:09:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-af-blend-rod-2-000-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:09:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1736s11-osha-stairway-36-width-11-stairs>: HTTP status code is not handled or not allowed
2026-01-10 20:09:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-s-b-3xnh-2amed048011-17186>: HTTP status code is not handled or not allowed
2026-01-10 20:09:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gn471-1-crank-handles-zinc-die-cast-revolving-handle-through-round-bore-10mm-3-15-l>: HTTP status code is not handled or not allowed
2026-01-10 20:09:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1150-wintertuff-ice-traction-spikes-black-studded-outsole-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:09:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35211-steel-toe-pvc-overshoes-blackyellow-md>: HTTP status code is not handled or not allowed
2026-01-10 20:09:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-ft-dvi-d-cable-dual-link-male-to-male-black>: HTTP status code is not handled or not allowed
2026-01-10 20:09:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tyvek174-shipping-tag-4-34l-x-2-38w-green-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:09:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tyvek174-shipping-tag-6-14l-x-3-18w-green-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:09:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slatwall-counter-top-cube-display-fixture-birch-w-spinner-base>: HTTP status code is not handled or not allowed
2026-01-10 20:09:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chipboard-pads-24l-x-12w-kraft-275pack>: HTTP status code is not handled or not allowed
2026-01-10 20:09:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-shelf-steel-shelving-with-24-akrobins-36x12x39>: HTTP status code is not handled or not allowed
2026-01-10 20:09:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tomcat-camber-adjustment-tool>: HTTP status code is not handled or not allowed
2026-01-10 20:09:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/woodruff-key-m3-w-x-m3-7-outer-dia-carbon-steel-plain-din-6888>: HTTP status code is not handled or not allowed
2026-01-10 20:09:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fda-silicone-rubber-strip-with-high-temp-adhesive-50a-132-thick-x-2-wide-x-30-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:09:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j53107-35mm-industrial-work-hooded-jacket-yellow-md>: HTTP status code is not handled or not allowed
2026-01-10 20:09:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-shaped-electric-height-adjustable-desk-60-w-24-d-walnut-w-gray-base>: HTTP status code is not handled or not allowed
2026-01-10 20:09:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x11-2x5-71-2x1-2-wa46-j-v-white-aluminum-oxi>: HTTP status code is not handled or not allowed
2026-01-10 20:09:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-drawer-aluminum-tall-anesthesia-cart-push-button-lock-dark-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:09:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-shaped-electric-height-adjustable-desk-60-w-24-d-white-w-gray-base>: HTTP status code is not handled or not allowed
2026-01-10 20:09:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j24122-icon-jacket-fluorescent-yellowgreenblack-5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:09:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/63-black-original-ink-cartridge-190-page-yield>: HTTP status code is not handled or not allowed
2026-01-10 20:09:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-1-2-x-7-8-alu-60-t27reg-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:09:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-70075-123-3a-12-awg-3-conductor-x-75-ft-20-amp-single-outlet-with-cord>: HTTP status code is not handled or not allowed
2026-01-10 20:09:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j67113-stormflex-zipper-front-hooded-jacket-black-lg>: HTTP status code is not handled or not allowed
2026-01-10 20:09:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3x1-32x1-4-t1-a60-r-bf-cutoff-wheel>: HTTP status code is not handled or not allowed
2026-01-10 20:09:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/13-shelf-steel-shelving-with-48-akro-mils-shelf-bins-2>: HTTP status code is not handled or not allowed
2026-01-10 20:09:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-non-woven-medium-quick-change-disc>: HTTP status code is not handled or not allowed
2026-01-10 20:09:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/902xl-high-yield-black-original-ink-cartridge-825-page-yield>: HTTP status code is not handled or not allowed
2026-01-10 20:09:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1000-weather-fashions-commuter-rubber-overshoes-black-sm>: HTTP status code is not handled or not allowed
2026-01-10 20:09:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filter-regulator-lubricator-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:09:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wetordry-tri-m-ite-coated-paper-sheet-3>: HTTP status code is not handled or not allowed
2026-01-10 20:09:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/58a-black-original-laserjet-toner-cartridge-3000-page-yield>: HTTP status code is not handled or not allowed
2026-01-10 20:10:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/homak-40-gallon-parts-washer>: HTTP status code is not handled or not allowed
2026-01-10 20:10:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/89a-black-original-laserjet-toner-cartridge-5000-page-yield>: HTTP status code is not handled or not allowed
2026-01-10 20:10:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-basket-truck-24-bu-red-vinyl-wood-base-2-rg-2-sw>: HTTP status code is not handled or not allowed
2026-01-10 20:10:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamper-bag-blue-vinyl-standard-pocket>: HTTP status code is not handled or not allowed
2026-01-10 20:10:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/imperial-shelving-add-on-36x12x88-7-openings-sand>: HTTP status code is not handled or not allowed
2026-01-10 20:10:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-locker-bench-hardwood-top-w-ss-trapezoid-pedestals-bolt-down-48x9-1-2x17>: HTTP status code is not handled or not allowed
2026-01-10 20:10:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s61317-tuffenuff-3-pc-suit-gold-detachable-hood-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:10:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylatron-nsm-sheet-0-375-thick-x-24-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-tag-3-3-34l-x-1-78w--fluorescent-red-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perm-liner-truck-10-bu-gray-vinyl-wire-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 20:10:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/haz-mat-foam-inserts-for-1-gallon-paint-can-8-12l-x-8-12w-x-1-14h-white-100pk>: HTTP status code is not handled or not allowed
2026-01-10 20:10:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7w-120v-warm-white-flood-led-uplight-hartford-green-texture>: HTTP status code is not handled or not allowed
2026-01-10 20:10:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o24129-icon-snap-fly-front-overall-fluorescent-orange-sm>: HTTP status code is not handled or not allowed
2026-01-10 20:10:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-tag-12-8l-x-4w-light-blue-500pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-50a-12-thick-x-36-wide-x-6-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:10:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 17983 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:10:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-roll-no-adhesive-50a-12-thick-x-36-wide-x-5-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:10:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-tag-pre-strung-4-4-14l-x-2-18w-fluorescent-red-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-wall-corrugated-sheets-60l-x-48w-kraft-5pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perm-liner-truck-12-bu-yellow-vinyl-wood-base-2-rg-2-sw>: HTTP status code is not handled or not allowed
2026-01-10 20:10:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/del-doublebend-wand-50-l-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:10:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j22201-iron-eagle-storm-fly-front-jacket-blue-hood-snaps-lg>: HTTP status code is not handled or not allowed
2026-01-10 20:10:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perm-liner-truck-12-bu-green-vinyl-wood-base-2-rg-2-sw>: HTTP status code is not handled or not allowed
2026-01-10 20:10:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-tag-pre-strung-12-8l-x-4w-red-500pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-mesh-partition-security-room-30x20x8-with-roof-4-sides-w-window>: HTTP status code is not handled or not allowed
2026-01-10 20:10:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shipping-tag-pre-wired-4-4-14l-x-2-18w-fluorescent-pink-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/del-lance-w-flat-end-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:10:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strength-bunan-rubber-sheet-no-adhesive-60a-18-thick-x-36-wide-x-36-long>: HTTP status code is not handled or not allowed
2026-01-10 20:10:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-storage-locker-1-adjustable-center-shelf-24-x-60>: HTTP status code is not handled or not allowed
2026-01-10 20:10:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-machine-table-30-x-48-x-30>: HTTP status code is not handled or not allowed
2026-01-10 20:10:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/del-vacuum-hose-yellow-50-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/del-vacuum-hose-yellow-20-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/del-vacuum-hose-white-20-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gorbel-hd-wall-bracket-jib-crane-10-ft-span-and-200and-176-rotation-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:10:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gorbel-hd-wall-cantilever-jib-crane-8-ft-span-and-200and-176-rotation-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:10:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/j22207-iron-eagle-storm-fly-front-jacket-gold-hood-snaps-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:10:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-his-sheet-0-093-thick-x-48-000-w-x-96-000-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3772-printed-message-carton-sealing-tape-2-x-110-yds-2-2-mil-white-red-36-rolls-case>: HTTP status code is not handled or not allowed
2026-01-10 20:10:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/del-serrated-nozzle-8-l-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:10:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gorbel-steel-gantry-crane-15-ft-span-and-15-ft-fixed-height-10000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:10:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-his-sheet-0-187-thick-x-48-w-x-96-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gss-saftey-8007-quilted-jacket-class-3-lime-black-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:10:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oscillating-wall-mount-fan-24-diameter-2>: HTTP status code is not handled or not allowed
2026-01-10 20:10:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gss-saftey-6501-rain-coat-class-3-lime-black-2xl-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:10:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p56007-durascrim-plain-front-pants-yellow-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:10:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gss-saftey-8711-quilted-pants-class-e-lime-black-l-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:10:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cubby-locker-welded-34-1-2w-x-13-1-2d-x-66h-15-compartments-sand>: HTTP status code is not handled or not allowed
2026-01-10 20:10:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/odorstroyer-extra-biological-cleaner-and-deodorizer-gallon-bottle-4-bottles-case>: HTTP status code is not handled or not allowed
2026-01-10 20:10:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gpo-3-u-channel-2120-0-156-thick-x-11-5-w-x-1-437-leg-x-10-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5300-flatback-tape-1-x-60-yds-5-mil-brown-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-gpo-3-sheet-1-250-thick-x-48-w-x-48-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ovation-low-maintenance-floor-finish-5-gallon-pail>: HTTP status code is not handled or not allowed
2026-01-10 20:10:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gpo-3-angle-2882-utr1494-0-250-thick-x-1-500-w-x-10-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-72-w-x-18-d-x-74-h>: HTTP status code is not handled or not allowed
2026-01-10 20:10:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-lift-platform-20-bushel-plastic-box-truck>: HTTP status code is not handled or not allowed
2026-01-10 20:10:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-top-machine-table-24-x-36-x-42-swivel-casters-w-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:10:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-citrus-cleaner-gallon-bottle-4-bottles-case>: HTTP status code is not handled or not allowed
2026-01-10 20:10:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deo-3-deodorant-concentrate-fruity-sweet-275-gallon-tote>: HTTP status code is not handled or not allowed
2026-01-10 20:10:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-steel-shelving-5-shelves-24-x-48>: HTTP status code is not handled or not allowed
2026-01-10 20:10:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swisher-rc14544cp4k-14-5-hp-44in-deck-rough-cut-trailmower-with-kawasaki-engine>: HTTP status code is not handled or not allowed
2026-01-10 20:10:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nomex-410-sheet-0-010-thick-x-24-000-w-x-36-000-l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reverse-tuck-folding-cartons-4-1316l-x-1-14w-x-4-1316h-kraft-250pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/literature-organizer-modular-storage-cabinet-8>: HTTP status code is not handled or not allowed
2026-01-10 20:10:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyester-strapping-1-2-wide-x-5800>: HTTP status code is not handled or not allowed
2026-01-10 20:10:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aspect-peel-stick-wood-tile-petrefied-forest-a70-01>: HTTP status code is not handled or not allowed
2026-01-10 20:10:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gift-boxes-4l-x-4w-x-4h-kraft-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ntep-pallet-scale-with-led-indicator-4-x-4-5-000-lb-x-1-lb>: HTTP status code is not handled or not allowed
2026-01-10 20:10:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-sign-yield-080mm-thick>: HTTP status code is not handled or not allowed
2026-01-10 20:10:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ramp-for-4-x-4-ntep-pallet-scale-40-l-x48-w-x-4-3-16-h-10-000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:10:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/195173-3-dust-extraction-cup-set-for-rotary-hammers>: HTTP status code is not handled or not allowed
2026-01-10 20:10:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/libman-commercial-freedom-dust-mop>: HTTP status code is not handled or not allowed
2026-01-10 20:10:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/great-lakes-tin-jamestown-2-x-2-nail-up-tin-ceiling-tile-in-clear-t51-04>: HTTP status code is not handled or not allowed
2026-01-10 20:10:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g5-145t-aff-7-5hp-oil-injected-rotary-screw-71-gal-tank-145psi-1ph-230v-w-dryer>: HTTP status code is not handled or not allowed
2026-01-10 20:10:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mixed-cellulose-ester0-80-um-47-mm-diameter-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:10:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/welded-workbench-w-open-base-36-x-84>: HTTP status code is not handled or not allowed
2026-01-10 20:10:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/482423098a-clip-s3-add-on-rack-unit-98-h-x-48-w-x-24-d-6xms230-shelves-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 20:10:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quartz-high-purity-sio2-binderless-glass-microfiber-filter-8-x-10-sheets-2-2-um-25-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:10:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/great-lakes-tin-saginaw-2-x-2-nail-up-tin-ceiling-tile-in-antique-white-t53-02>: HTTP status code is not handled or not allowed
2026-01-10 20:10:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/51-natural-rubber-tape-2-x-55-yds-22-mil-clear-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tjv-350a-commercial-storage-tank-jacketed-custom>: HTTP status code is not handled or not allowed
2026-01-10 20:10:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aspect-3-x-6-peel-stick-glass-decorative-wall-tile-in-frost-8-pack-a50-63>: HTTP status code is not handled or not allowed
2026-01-10 20:10:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-dvd-mailers-7-58l-x-6w-x-5-716h-white-50pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-bike-wave-black-below-ground-mount-2>: HTTP status code is not handled or not allowed
2026-01-10 20:10:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/great-lakes-tin-48-superior-tin-crown-molding-in-penny-vein-194-05>: HTTP status code is not handled or not allowed
2026-01-10 20:10:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5400-flatback-tape-3-x-60-yds-8-mil-natural-white-16pack>: HTTP status code is not handled or not allowed
2026-01-10 20:10:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d-wa-bdrill-dck277c2>: HTTP status code is not handled or not allowed
2026-01-10 20:10:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-with-36-shelf-bins-13-shelves-36x12x75-4>: HTTP status code is not handled or not allowed
2026-01-10 20:10:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-casing-flexible-shaft-for-916-1-id-tubes-25l>: HTTP status code is not handled or not allowed
2026-01-10 20:10:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-shelving-with-36-shelf-bins-13-shelves-36x18x75-4>: HTTP status code is not handled or not allowed
2026-01-10 20:10:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2221vs-coupler-tble-raiser-5516860>: HTTP status code is not handled or not allowed
2026-01-10 20:10:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/libman-commercial-resin-jaw-mop-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:10:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelving-with-10-hopper-bins-36x18x75-4>: HTTP status code is not handled or not allowed
2026-01-10 20:10:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/auxiliary-pan-for-p230-series-ultrasonic-part-cleaners>: HTTP status code is not handled or not allowed
2026-01-10 20:10:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hopper-bins-10-7-8w-x-17-1-2d-x-12-1-2h-5>: HTTP status code is not handled or not allowed
2026-01-10 20:10:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-surface-vinegar-cleaner-fresh-clean-scent-23-oz-spray-bottle-8-case>: HTTP status code is not handled or not allowed
2026-01-10 20:10:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-wire-shelving-60wx24dx54h>: HTTP status code is not handled or not allowed
2026-01-10 20:10:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7060-knob-adjusting-5512342>: HTTP status code is not handled or not allowed
2026-01-10 20:10:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-step-aluminum-rolling-ladder-24-w-grip-step-30-handrails>: HTTP status code is not handled or not allowed
2026-01-10 20:10:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultrasonic-table-top-parts-cleaning-system-digital-timer-heat-1-5-gal-45-khz-115v>: HTTP status code is not handled or not allowed
2026-01-10 20:10:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultrasonic-table-top-parts-cleaning-system-digital-timer-heat-3-25-gal-45-khz-115v>: HTTP status code is not handled or not allowed
2026-01-10 20:11:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fresh-products-wave-3d-urinal-deodorizer-screen-blue-cotton-blossom-10-box-60-screens-ct>: HTTP status code is not handled or not allowed
2026-01-10 20:11:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-aluminum-rolling-ladder-24-w-ribbed-step-30-handrails>: HTTP status code is not handled or not allowed
2026-01-10 20:11:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-spin-grit-brush-w-standard-threading-for-34-id-tubes-pack-of-15>: HTTP status code is not handled or not allowed
2026-01-10 20:11:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-wire-shelving-add-on-72wx24dx54h>: HTTP status code is not handled or not allowed
2026-01-10 20:11:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/biwm2424-24-x-24-drywall-bead-flange-mortise-lock-prep>: HTTP status code is not handled or not allowed
2026-01-10 20:11:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fresh-products-ourfresh-airfreshener-spiced-apple-48-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-spin-grit-brush-w-quick-connect-for-12-id-tubes-pack-of-15>: HTTP status code is not handled or not allowed
2026-01-10 20:11:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/illinois-engineered-products-single-folding-gate-11w-to-12w-and-7h>: HTTP status code is not handled or not allowed
2026-01-10 20:11:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-wire-add-on-72wx14dx74h>: HTTP status code is not handled or not allowed
2026-01-10 20:11:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emerel-multi-surface-creme-cleanser-fresh-scent-32-oz-bottle-12-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-carbon-steel-utility-blades-pack-of-20>: HTTP status code is not handled or not allowed
2026-01-10 20:11:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/professional-antimicrobial-foaming-hand-wash-original-1000-ml-3-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-tier-single-entry-tire-track>: HTTP status code is not handled or not allowed
2026-01-10 20:11:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/free-and-clear-liquid-laundry-detergent-unscented-150-oz-bottle-4-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-kit-60-w-workbench-with-18-w-louver-36-w-whiteboard-mounting-rail-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:11:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4c-horizontal-mailbox-37-1-2h-double-10-mb1-2-pl-doors-front-load-aluminum-usps>: HTTP status code is not handled or not allowed
2026-01-10 20:11:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18082 pages (at 99 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:11:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bntc1824-18-x-24-exposed-flange-cam-latch>: HTTP status code is not handled or not allowed
2026-01-10 20:11:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-8-stainless-steel-stock-pot-w-cover-80-qt>: HTTP status code is not handled or not allowed
2026-01-10 20:11:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/intensive-care-essential-healing-body-lotion-20-3-oz-pump-bottle>: HTTP status code is not handled or not allowed
2026-01-10 20:11:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/press-n-pour-2-gallon-gas-can-gb320>: HTTP status code is not handled or not allowed
2026-01-10 20:11:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/advanced-therapy-moisturizing-hand-body-lotion-16oz-pump-bottle-12-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-qt-sauce-pan-the-point-two-five-line>: HTTP status code is not handled or not allowed
2026-01-10 20:11:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/control-moisturizing-hand-and-body-lotion-fresh-scent-1-l-bottle-6-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-bin-and-shelf-cart-w-two-louvered-panel-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:11:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/non-ammoniated-glass-multi-surface-cleaner-pleasant-scent-128-oz-bottle>: HTTP status code is not handled or not allowed
2026-01-10 20:11:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-casing-flexible-shaft-for-716-12-id-tubes-25l>: HTTP status code is not handled or not allowed
2026-01-10 20:11:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/03-829cb-blk-retractable-cone-bar-4-6-black-gold>: HTTP status code is not handled or not allowed
2026-01-10 20:11:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7020-bottom-cylinder-pin-5519497>: HTTP status code is not handled or not allowed
2026-01-10 20:11:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bitk3636-36-x-36-exposed-flange-knurled-knob>: HTTP status code is not handled or not allowed
2026-01-10 20:11:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-225-tig-welder-200-299a-60hz-460575v>: HTTP status code is not handled or not allowed
2026-01-10 20:11:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brhpa30x96s1t-30-x-96-personnel-ii-roof-hatch-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:11:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-intermediate-coalescing-filter-w-float-drain>: HTTP status code is not handled or not allowed
2026-01-10 20:11:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-comfort-cross-over-style-positioning-climbing-harness-1140199-s>: HTTP status code is not handled or not allowed
2026-01-10 20:11:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/embassy-34-element-72-panel-track-heaters>: HTTP status code is not handled or not allowed
2026-01-10 20:11:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/497-diamond-plate-diamond-plate-ergonomic-mat-48-x-75-x-5-8-black>: HTTP status code is not handled or not allowed
2026-01-10 20:11:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drc-wipers-white-10-x-12-centerpull-200-box>: HTTP status code is not handled or not allowed
2026-01-10 20:11:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4210-screw-516x12-5513055>: HTTP status code is not handled or not allowed
2026-01-10 20:11:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/560-ergodeck-heavy-duty-inside-corner-6x9-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:11:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/embassy-bracket-end-block-kit-brass>: HTTP status code is not handled or not allowed
2026-01-10 20:11:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fabric-softener-sheets-fresh-scent-120-sheets-box-6-boxes-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-wave-stt-process-module-40-vdc>: HTTP status code is not handled or not allowed
2026-01-10 20:11:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-clean-water-plastic-cap-641410-641411-floor-scrubbers>: HTTP status code is not handled or not allowed
2026-01-10 20:11:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelving-48x18x96-with-5-shelves-no-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:11:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24v-ss11-xr-cordless-snow-shovel-24-volt-11-inch-5-ah>: HTTP status code is not handled or not allowed
2026-01-10 20:11:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dissolvetech-paper-towel-7-5-x-700-ft-white-6-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flammable-cabinet-with-self-close-double-door-30-gallon>: HTTP status code is not handled or not allowed
2026-01-10 20:11:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/embassy-ksp-splicer-set>: HTTP status code is not handled or not allowed
2026-01-10 20:11:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/msw-72-3-shrink-wrap-roll-cart-3-roll-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:11:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/click-gel-automatic-toilet-bowl-cleaner-ocean-fresh-6-box-4-boxes-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swa-r-82-aw-approach-ramp-for-swa-82-aw-wrap-machine-48>: HTTP status code is not handled or not allowed
2026-01-10 20:11:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swa-60-semi-automatic-stretch-wrap-machine-60-diameter>: HTTP status code is not handled or not allowed
2026-01-10 20:11:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pre-treat-stain-remover-liquid-60-oz-bottle-6-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mounting-bracket-for-arrow-modular-units>: HTTP status code is not handled or not allowed
2026-01-10 20:11:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metro-stackable-sidechair-black-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 20:11:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dishwashing-liquid-original-scent-90-oz-bottle-4-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/food-safe-motor-cfswdm3546t-e-ip69-1-hp-1760-rpm-3-ph-60-hz-143t-c-3522m-tenv-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:11:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heataround-360-kit-hakitdg>: HTTP status code is not handled or not allowed
2026-01-10 20:11:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-2000sf-high-performance-back-support-black-medium>: HTTP status code is not handled or not allowed
2026-01-10 20:11:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-stool-21-in-28-in-seat-height-black-vinyl-chrome-steel-base-el>: HTTP status code is not handled or not allowed
2026-01-10 20:11:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-standard-particulate-filter-w-poly-bowl-float-drain>: HTTP status code is not handled or not allowed
2026-01-10 20:11:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vfswdnm3558t-e-ip69-2hp-1750rpm-3ph-60hz-145tc-3546m-tenv-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:11:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flextec-650x-multi-process-welder-w-crosslinc-technology-815a-5060hz-red>: HTTP status code is not handled or not allowed
2026-01-10 20:11:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-8-breather-vent>: HTTP status code is not handled or not allowed
2026-01-10 20:11:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-speed-control>: HTTP status code is not handled or not allowed
2026-01-10 20:11:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cfswdm3615t-5e-ip69-5hp-1750rpm-3ph-60hz-184tc-3646m-tefc-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:11:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onsite-fd-87ssd-cross-cut-multimedia-office-shredder-for-mobile-phones-4-gal-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:11:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-storage-drawer-cabinet-30x27x60-2>: HTTP status code is not handled or not allowed
2026-01-10 20:11:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-lab-coat-no-pockets-elastic-wrists-snap-front-single-collar-white-sm-30cs>: HTTP status code is not handled or not allowed
2026-01-10 20:11:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-storage-drawer-cabinet-48x24x60-8>: HTTP status code is not handled or not allowed
2026-01-10 20:11:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-midflow-regulator-with-gauge-t-handle-215-scfm>: HTTP status code is not handled or not allowed
2026-01-10 20:11:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7020-grib--ref-154-5714181>: HTTP status code is not handled or not allowed
2026-01-10 20:11:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/335-retracting-belt-stanchion-yellow-post-red-white-belt-rubber-base-35-l>: HTTP status code is not handled or not allowed
2026-01-10 20:11:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-midflow-regulator-with-gauge-t-handle-220-scfm>: HTTP status code is not handled or not allowed
2026-01-10 20:11:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x-1-7-8-drywall-screw-phillips-bugle-head-black-phosphate-tek-self-drilling-pt-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:11:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toilet-paper-septic-safe-1-ply-white-1000-sheets-roll-12-rolls-pack-4-pack-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eccotemp-fvi12-ng-liquid-propane-indoor-forced-vent-tankless-water-heater>: HTTP status code is not handled or not allowed
2026-01-10 20:11:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chill-its-6630-high-performance-cap-navy-western-one-size>: HTTP status code is not handled or not allowed
2026-01-10 20:11:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-beard-cover-100-latex-free-white-18-100bag-10-bagcase>: HTTP status code is not handled or not allowed
2026-01-10 20:11:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x-2-drywall-screw-phillips-bugle-head-steel-black-phosphate-sharp-point-pkg-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:11:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8225hl-class-2-standard-vest-orange-l-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:11:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/410-airug-anti-fatigue-mat-38-thick-3w-x-60l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:11:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/x80-cloths-with-hydroknit-jumbo-roll-12-1-2-x-13-2-5-white-475-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:11:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7020-magnetic-switch-1-phase-5713041>: HTTP status code is not handled or not allowed
2026-01-10 20:11:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/versatile-single-storage-unassembled-46-3-4w-x-12d-x-33-7-8h>: HTTP status code is not handled or not allowed
2026-01-10 20:11:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a697-60-deluxe-razor-x-cutter-60>: HTTP status code is not handled or not allowed
2026-01-10 20:11:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7020-screw-516x12-ref-162-5714261>: HTTP status code is not handled or not allowed
2026-01-10 20:11:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jrt-jumbo-bath-tissue-septic-safe-2-ply-white-3-3-x-500-ft-12-case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-1051-mesh-back-support-black-large>: HTTP status code is not handled or not allowed
2026-01-10 20:11:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/essential-jrt-jumbo-roll-bathroom-tissue-septic-safe-1-ply-white-2000-ft-12-rolls>: HTTP status code is not handled or not allowed
2026-01-10 20:11:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sms-lab-coat-3-pockets-knit-wrists-snap-front-knit-collar-white-xl-30case>: HTTP status code is not handled or not allowed
2026-01-10 20:11:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/table-pin-5783481>: HTTP status code is not handled or not allowed
2026-01-10 20:11:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8215ba-class-2-econo-breakaway-vest-lime-s-m>: HTTP status code is not handled or not allowed
2026-01-10 20:11:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/half-frame-safety-glasses-anti-fog-smoke-lens-blue-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:11:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cut-true-31h-hydraulic-guillotine-cutter-28-1116-cutting-length-950-sheet-capacity-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:11:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8289-class-2-economy-t-shirt-orange-5-x-large>: HTTP status code is not handled or not allowed
2026-01-10 20:12:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hnd-wheel-5630231>: HTTP status code is not handled or not allowed
2026-01-10 20:12:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-mobile-dunnage-rack-42-lx20-wx8-h>: HTTP status code is not handled or not allowed
2026-01-10 20:12:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tennsco-capstone-boltless-shelving-add-on-unit-42-w-x-24-d-x-76-h-5-shelves-medium-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:12:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/st-2009-water-closet-and-royal-111-flushometer>: HTTP status code is not handled or not allowed
2026-01-10 20:12:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-probe-wifi-data-logger-for-ultra-low-freezers>: HTTP status code is not handled or not allowed
2026-01-10 20:12:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/32oz-natural-hdpe-wide-mouth-round-bottle-with-53-400-white-pp-cap-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:12:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ypz100h-b-by-universal-heavy-weight-caution-mat-pads-19-by-15-yellow-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:12:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flag-highlighters-38w-x-134l-assorted-colors-blue-pink-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:12:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/squids-3115-wrist-lanyard-black-s-m>: HTTP status code is not handled or not allowed
2026-01-10 20:12:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8230z-class-2-two-tone-vest-orange-s-m>: HTTP status code is not handled or not allowed
2026-01-10 20:12:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-adjustable-heavy-duty-shelf-18-wx54-l>: HTTP status code is not handled or not allowed
2026-01-10 20:12:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foodsafe-cfswdnm3555t-e-ip69-2hp-3480rpm-3ph-60hz-145tc-3546m-tenv-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:12:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-h-wall-mount-unit-w-vesa-mount-black>: HTTP status code is not handled or not allowed
2026-01-10 20:12:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foodsafe-cfswdnm3555-e-ip69-2hp-3480rpm-3ph-60hz-56c-3546m-tenv-f1-n>: HTTP status code is not handled or not allowed
2026-01-10 20:12:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screw-pan-hd-phillips-m5x8mm-5712561>: HTTP status code is not handled or not allowed
2026-01-10 20:12:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combo-lateral-file-31wx22d-mocha>: HTTP status code is not handled or not allowed
2026-01-10 20:12:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protractor-stop-block-7020-5712721>: HTTP status code is not handled or not allowed
2026-01-10 20:12:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18178 pages (at 96 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:12:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-shelf-storage-cabinet-31wx22d-mocha>: HTTP status code is not handled or not allowed
2026-01-10 20:12:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jamaica-beach-midback-folding-chair-blue-sling-w-a-white-resin-frame-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:12:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cannes-outdoor-stackable-dining-chair-charcoal-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 20:12:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/38387-clamp-and-multimeter-greenorange>: HTTP status code is not handled or not allowed
2026-01-10 20:12:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunset-stacking-outdoor-armchair-cognac-sling-on-fusion-bronze-frame-pack-of-16>: HTTP status code is not handled or not allowed
2026-01-10 20:12:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sm65-arch-strapping-machine-high-speed-automatic-850-x-600-9mm>: HTTP status code is not handled or not allowed
2026-01-10 20:12:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slim-seal-kit-for-manual-pallet-jack-truck-bt-129883-slim-fits-bt-models>: HTTP status code is not handled or not allowed
2026-01-10 20:12:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m12-fuel-12-volt-lithium-ion-brushless-cordless-1-4-hex-impact-driver-tool-only>: HTTP status code is not handled or not allowed
2026-01-10 20:12:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16oz-natural-hdpe-narrow-mouth-lab-style-bottle-w-28-415-natural-pp-linerless-cap-48pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-drawer-cabinet-workbench-shop-top>: HTTP status code is not handled or not allowed
2026-01-10 20:12:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-t-bar-3-shelf-rack-20-wx60-hx38-l>: HTTP status code is not handled or not allowed
2026-01-10 20:12:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jmd-15-mill-drill-with-newall-dp500-dro-1-hp-115-230v-1ph>: HTTP status code is not handled or not allowed
2026-01-10 20:12:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-workbench-48x30-with-fixed-legs>: HTTP status code is not handled or not allowed
2026-01-10 20:12:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/squids-3400-grabber-black>: HTTP status code is not handled or not allowed
2026-01-10 20:12:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-assembly-kit-4-2200-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:12:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jdp-20vs-3-20-vs-drill-press-1-1-2-drilling-capacity-2-horse-power-3-230-460v-3-phase>: HTTP status code is not handled or not allowed
2026-01-10 20:12:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-h-laptop-wall-mount-unit-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:12:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-adjustable-heavy-duty-shelf-20-wx72-l>: HTTP status code is not handled or not allowed
2026-01-10 20:12:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jet-jtm-1050evs2-230-mill-3-axis-newall-dp700-dro-knee-x-y-axis-powerfeed-air-power-drawbar>: HTTP status code is not handled or not allowed
2026-01-10 20:12:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-t-bar-4-shelf-rack-20-wx72-hx36-l>: HTTP status code is not handled or not allowed
2026-01-10 20:12:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jet-jtm-1050evs2-230-mill-3-axis-acu-rite-200s-dro-knee-x-axis-powerfeed-698169>: HTTP status code is not handled or not allowed
2026-01-10 20:12:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triumph-style-t1c-cobalt-jobbers-drill-bronze-oxide-38-6>: HTTP status code is not handled or not allowed
2026-01-10 20:12:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8225z-class-2-standard-vest-orange-4xl-5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:12:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/divider-24-d-x-9-h-stacking-bin-sold-per-package-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:12:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-mal-grit-grit-brush-stripping-w-np-9200-clutch-plate-black-813218np>: HTTP status code is not handled or not allowed
2026-01-10 20:12:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-tuff-block-polypropylene-scrub-brush-general-purpose-w-clutch-plate-772418np>: HTTP status code is not handled or not allowed
2026-01-10 20:12:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/retainer-5782841>: HTTP status code is not handled or not allowed
2026-01-10 20:12:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-10w-x-42l-2-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 20:12:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gear-74t-bdb-1340-04117a>: HTTP status code is not handled or not allowed
2026-01-10 20:12:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500ul-natural-pp-large-opening-vial-w-9-425mm-neck-finish-vial-only-1000pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gear-shaft-5625081>: HTTP status code is not handled or not allowed
2026-01-10 20:12:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-wicking-t-shirt-w-pocket-class-2-hi-vis-orange-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:12:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quill-jdp-17mmf-10905612>: HTTP status code is not handled or not allowed
2026-01-10 20:12:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-powder-coat-folding-bollard-42-h>: HTTP status code is not handled or not allowed
2026-01-10 20:12:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/128oz-amber-jug-w-38-400-black-phenolic-pulp-aluminum-foil-cap-6pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/basic-series-6-feet-steel-easy-slip-on-baseboard-heater-cover-white>: HTTP status code is not handled or not allowed
2026-01-10 20:12:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-sleeve-wicking-t-shirt-class-2-hi-vis-orange-m>: HTTP status code is not handled or not allowed
2026-01-10 20:12:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neoprene-cord-pad-6-x-6-x-1>: HTTP status code is not handled or not allowed
2026-01-10 20:12:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nut-hex-38-16-9056991>: HTTP status code is not handled or not allowed
2026-01-10 20:12:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8925-class-e-thermal-pants-lime-3-x-large>: HTTP status code is not handled or not allowed
2026-01-10 20:12:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-breathable-pants-waterproof-hi-viz-yellow-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:12:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cart-cover-10-gauge-vinyl-for-18-x-48-x-74-unit-zipper-closure-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:12:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cart-cover-10-gauge-vinyl-for-18-x-72-x-63-unit-zipper-closure-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:12:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-flame-resistant-pull-over-hoodie-hi-viz-yellow-large>: HTTP status code is not handled or not allowed
2026-01-10 20:12:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crew-sweatshirt-hi-vis-orange-medium>: HTTP status code is not handled or not allowed
2026-01-10 20:12:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5ml-disposable-polystyrene-beaker-1-3125-top-od-x-0-75-bottom-od-x-0-75-h-1000pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-8w-x-14l-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:12:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cart-cover-400-denier-nylon-for-18-x-36-x-74-unit-hook-loop-fastener-closure-red>: HTTP status code is not handled or not allowed
2026-01-10 20:12:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cart-cover-10-gauge-vinyl-for-18-x-36-x-63-unit-zipper-closure-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:12:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/train-horn-3-electronic-sounds-360>: HTTP status code is not handled or not allowed
2026-01-10 20:12:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speed-collection-premium-breathable-rain-pants-hi-viz-yellow-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:12:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8919-strapping-tape-1-x-60-yds-7-mil-clear-12pack>: HTTP status code is not handled or not allowed
2026-01-10 20:12:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acrylic-dispensing-bins-large-clear-7-14-w-x-12-12-d-x-11-h>: HTTP status code is not handled or not allowed
2026-01-10 20:12:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-w-coat-rack-with-4-double-prong-hooks-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:12:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/64oz-natural-hdpe-handled-round-jug-with-38-400-white-pp-pe-foam-lined-cap-6pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-lock-5-caster>: HTTP status code is not handled or not allowed
2026-01-10 20:12:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8365-class-3-rain-jacket-lime-5-x-large>: HTTP status code is not handled or not allowed
2026-01-10 20:12:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-one-table-of-contents-dividers-assorted-color-12-tab-months-letter-white>: HTTP status code is not handled or not allowed
2026-01-10 20:12:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xd-smooth-aluminum-underbody-with-barn-door-24x24x72-1705450>: HTTP status code is not handled or not allowed
2026-01-10 20:12:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/group-24-battery-tray-bt24s>: HTTP status code is not handled or not allowed
2026-01-10 20:12:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/group-31-battery-tray-bt31s>: HTTP status code is not handled or not allowed
2026-01-10 20:12:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4d-commercial-grade-battery-box-hm408>: HTTP status code is not handled or not allowed
2026-01-10 20:12:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8925-class-e-thermal-pants-orange-large>: HTTP status code is not handled or not allowed
2026-01-10 20:12:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xd-smooth-aluminum-underbody-with-barn-door-18x18x36-1705405>: HTTP status code is not handled or not allowed
2026-01-10 20:12:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-dummy-enclosure-only-30-series>: HTTP status code is not handled or not allowed
2026-01-10 20:12:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/128oz-clear-jug-w-38-400-black-phenolic-pulp-vinyl-cap-4pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprng-hbs-1321w-1321w-118>: HTTP status code is not handled or not allowed
2026-01-10 20:12:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/breathable-foul-weather-coat-hi-viz-orange-5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:12:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-5ml-pediatric-grad-to-0-3ml-ldpe-transfer-pipets-115mm-500-box-10-bx-unit-5000pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inventory-control-cone-hot-pink>: HTTP status code is not handled or not allowed
2026-01-10 20:12:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inventory-control-cone-with-dry-erase-decal-red>: HTTP status code is not handled or not allowed
2026-01-10 20:12:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-14w-x-18l-1-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:12:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insul-tube-6l-1-2-thick-3-5-8>: HTTP status code is not handled or not allowed
2026-01-10 20:12:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-14w-x-22l-1-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:12:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insul-tube-6l-2-thick-5-5-8>: HTTP status code is not handled or not allowed
2026-01-10 20:12:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-x-45mm-1-dram-vial-w-13-425-green-thermoset-f217-ptfe-lined-cap-cleaned-144pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-32mm-2ml-glass-big-mouth-screw-thread-vial-w-10-425-neck-finish-vial-only-1000pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2ml-amber-glass-standard-opening-crimp-top-vial-w-11mm-neck-finish-vial-only-1000pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/27-5-x-140mm-15-dram-clear-vial-w-24-400-green-thermoset-f217-ptfe-lined-cap-72pk>: HTTP status code is not handled or not allowed
2026-01-10 20:12:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sentry-water-cable-barrier-wall-orange-45043-o>: HTTP status code is not handled or not allowed
2026-01-10 20:12:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grid-max-100-sq-ft-kit-vinyl-copper-fantasy-282-11>: HTTP status code is not handled or not allowed
2026-01-10 20:12:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/molded-rubber-cable-protector-black>: HTTP status code is not handled or not allowed
2026-01-10 20:12:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/breathable-foul-weather-coat-hi-viz-yellow-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:13:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reduced-vibration-handle-ag4s-54-1>: HTTP status code is not handled or not allowed
2026-01-10 20:13:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quick-adjust-wire-shelf-truck-with-dolly-base-60x18x61-1600-pound-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:13:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neo-thumb-wrist-wrap-navy-large>: HTTP status code is not handled or not allowed
2026-01-10 20:13:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o-ring-295x2-ag4s-66>: HTTP status code is not handled or not allowed
2026-01-10 20:13:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-5w-x-7l-6-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-7-12w-x-7-12l-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-11-1-8-w-x23-5-8-d-x-6-h-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:13:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-visibility-premium-wicking-hoodie-hi-viz-orange-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:13:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/body-filler-file-holder-steel-1-1-2-w-x-2-1-2-d-x-13-h>: HTTP status code is not handled or not allowed
2026-01-10 20:13:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-l-x-12-1-2-h-scaffolding-unit>: HTTP status code is not handled or not allowed
2026-01-10 20:13:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-economy-back-support-belt-7176-01>: HTTP status code is not handled or not allowed
2026-01-10 20:13:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permanent-selfadhesive-colorcoding-labels-34in-dia-red-1008pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-hp-60-gallon-230v-ingersoll-rand-air-compressor>: HTTP status code is not handled or not allowed
2026-01-10 20:13:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/206401-8-powerflex-natural-rubber-80-100-8>: HTTP status code is not handled or not allowed
2026-01-10 20:13:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-5w-x-14l-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18276 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:13:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-edge-writing-pad-legalmargin-rule-legal-canary-50sheet-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:13:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s31kaorj-safety-padlock-1-38w-x-1-12h-shackle-org>: HTTP status code is not handled or not allowed
2026-01-10 20:13:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/miracool-hard-hat-pads-navy-24-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/miracool-deluxe-hard-hat-pad-with-shade-gray-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/distribution-container-with-hinged-lid-24-1-2x15x13-3-4-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:13:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/danger-hard-hat-area-10x14-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:13:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perforated-edge-writing-pad-jr-legal-rule-5-x-8-white-50sheet-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:13:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s31ltylw-safety-padlock-1-38w-x-3h-shackle-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:13:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knob-4224-6295832>: HTTP status code is not handled or not allowed
2026-01-10 20:13:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-8w-x-18l-3-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/411ltteal-safety-padlock-1-12wx-1-12h-shackle-teal>: HTTP status code is not handled or not allowed
2026-01-10 20:13:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glue-top-writing-pads-wide-rule-letter-white-50sheet-padspack-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:13:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s33teal-snap-lock-safety-padlock-1-38w-x-1-12h-teal>: HTTP status code is not handled or not allowed
2026-01-10 20:13:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/411kas6ylw-safety-padlock-1-12w-x-1-12h-yellow-6set>: HTTP status code is not handled or not allowed
2026-01-10 20:13:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/separating-set-with-pulling-device-7-8-22-mm-to-4-1-2-115-mm-open>: HTTP status code is not handled or not allowed
2026-01-10 20:13:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-first-foot-protection-required-in-this-area-10x14-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:13:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-tie-hat-with-elastic-rear-band-assorted-colors-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/private-parking-unauthorized-cars-will-be-towed-18x12-063-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:13:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-cover-mdl-ghbbdb-1340a-32a5114>: HTTP status code is not handled or not allowed
2026-01-10 20:13:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-sign-walk-on-forklift-traffic-area-17in-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:13:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wirebound-notebook-8-x-1012-wide-ruled-100-sheets-assorted-color-cover>: HTTP status code is not handled or not allowed
2026-01-10 20:13:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sponge-cup-moistener-3-dia-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:13:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprng-washer-m8x2-f25-29>: HTTP status code is not handled or not allowed
2026-01-10 20:13:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/checklite-safety-glassesuncoated-clear-lens-cl010>: HTTP status code is not handled or not allowed
2026-01-10 20:13:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-jaw-self-centering-puller-15-ton-capacity-1-4-to-2-3-8-open-2-reach->: HTTP status code is not handled or not allowed
2026-01-10 20:13:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knob-41002-41>: HTTP status code is not handled or not allowed
2026-01-10 20:13:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3lhwht-laminated-steel-safety-padlock-1-916w-x-2h-shackle-white>: HTTP status code is not handled or not allowed
2026-01-10 20:13:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contemporary-melrose-white-leather-sofa-with-encasing-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:13:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-spacer-jdp-20evs-20evs-h36>: HTTP status code is not handled or not allowed
2026-01-10 20:13:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-3w-x-7l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-vise-fmz-with-clamp>: HTTP status code is not handled or not allowed
2026-01-10 20:13:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-building-and-engraving-set>: HTTP status code is not handled or not allowed
2026-01-10 20:13:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gauges-62-1176-mar10-9268>: HTTP status code is not handled or not allowed
2026-01-10 20:13:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-5w-x-6l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-ii-solid-poly-fluorescent-lime-safety-vest-vcl2slxl>: HTTP status code is not handled or not allowed
2026-01-10 20:13:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chain-plastic-1-1-2-links-on-a-reel-black-200-feet-trade-size-6>: HTTP status code is not handled or not allowed
2026-01-10 20:13:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-premium-locker-triple-tier-12x18x24-9-door-assembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:13:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/406kas6orj-safety-padlock-orange-6set>: HTTP status code is not handled or not allowed
2026-01-10 20:13:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pathway-hd-code-compliant-wheelchair-ramp-kit-28-x-48-w-guards-3-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:13:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/centers-28-1031-vul404145-1>: HTTP status code is not handled or not allowed
2026-01-10 20:13:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shockwave2-100-6-ft-1244409>: HTTP status code is not handled or not allowed
2026-01-10 20:13:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pathway-3g-platform-5-x5-expanded-metal-2-line-handrail-65-1-2-out-w-x-65-1-2-out-l>: HTTP status code is not handled or not allowed
2026-01-10 20:13:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21579-half-mask-respirator-large-f-organic-v-5303>: HTTP status code is not handled or not allowed
2026-01-10 20:13:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-10w-x-24l-3-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-8w-x-9l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gaskets-32-1120-cle07136>: HTTP status code is not handled or not allowed
2026-01-10 20:13:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-9w-x-9l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hoses-32-1374-cle08510>: HTTP status code is not handled or not allowed
2026-01-10 20:13:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harn-pt-1d-xl-first-ab17510-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:13:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hndl-lever-gh-1340w-gh1440w-06-10>: HTTP status code is not handled or not allowed
2026-01-10 20:13:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermostats-46-1068-sta2t-1427b8701>: HTTP status code is not handled or not allowed
2026-01-10 20:13:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pin-bd-920n-bd920n-ts40>: HTTP status code is not handled or not allowed
2026-01-10 20:13:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gear-38t-bd920w-2020>: HTTP status code is not handled or not allowed
2026-01-10 20:13:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-static-shielding-bags-4w-x-5l-28-mil-transparent-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/25-lbs-drum-rubber-base>: HTTP status code is not handled or not allowed
2026-01-10 20:13:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n99-premium-particulaterespirator-2310n99>: HTTP status code is not handled or not allowed
2026-01-10 20:13:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-24w-x-48l-6-mil-clear-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-fittings-1-2-equal-tee-w-tube>: HTTP status code is not handled or not allowed
2026-01-10 20:13:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheel-hbs56s-385-1>: HTTP status code is not handled or not allowed
2026-01-10 20:13:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23-poly-grout-bag>: HTTP status code is not handled or not allowed
2026-01-10 20:13:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pin-jbj12-33>: HTTP status code is not handled or not allowed
2026-01-10 20:13:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jet-jwl-1440vs-14in-x-40in-benchtop-wood-lathe>: HTTP status code is not handled or not allowed
2026-01-10 20:13:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-mortar-hoe-66-wood-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:13:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30319568>: HTTP status code is not handled or not allowed
2026-01-10 20:13:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-s1436gz-green-wire-shelf-36-wx14-d>: HTTP status code is not handled or not allowed
2026-01-10 20:13:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s1-safety-quick-coupling-1-2-high-flow-interchange-3-8-fnpt-connection>: HTTP status code is not handled or not allowed
2026-01-10 20:13:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-premium-locker-six-tier-12x15x12-6-door-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:13:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/funnels-68-374-ham952493205>: HTTP status code is not handled or not allowed
2026-01-10 20:13:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-premium-locker-six-tier-12x18x12-18-door-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:13:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/55-515-wonder-bar-pry-bar-12-3-4-inch-long>: HTTP status code is not handled or not allowed
2026-01-10 20:13:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rear-cover-ghb-1340-ghb1340-4103>: HTTP status code is not handled or not allowed
2026-01-10 20:13:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-24in-w-steel-safety-angle-rolling-ladder-perforated-tread-gray-kdec107246>: HTTP status code is not handled or not allowed
2026-01-10 20:13:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motors-68-1302-hoss-0730>: HTTP status code is not handled or not allowed
2026-01-10 20:13:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shell-reamer-arbor-morse-taper-shank-mt4-x-1-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:13:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clutch-dog-431430450-j1010-47>: HTTP status code is not handled or not allowed
2026-01-10 20:13:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-steel-24in-w-tilt-roll-ladder-grip-strut-tread-kdtf106242>: HTTP status code is not handled or not allowed
2026-01-10 20:13:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tinner-s-riveting-hammers-27g>: HTTP status code is not handled or not allowed
2026-01-10 20:13:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/setting-paneing-hammers-31g>: HTTP status code is not handled or not allowed
2026-01-10 20:13:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-step-24in-w-steel-safety-angle-rolling-ladder-perforated-tread-safety-yellow-kdec109246-y>: HTTP status code is not handled or not allowed
2026-01-10 20:13:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-step-16in-w-steel-safety-angle-rolling-ladder-grip-strut-gray-kdec103162>: HTTP status code is not handled or not allowed
2026-01-10 20:13:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-4w-x-10l-6-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:13:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-inch-large-handle-pry-bar>: HTTP status code is not handled or not allowed
2026-01-10 20:13:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-to-connect-fittings-1-4-equal-union-w-tube>: HTTP status code is not handled or not allowed
2026-01-10 20:13:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-chrome-18w-x-36l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:13:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-step-16in-w-30in-d-top-step-steel-rolling-ladder-perforated-tread-36in-handrail-kdsr102166-d3>: HTTP status code is not handled or not allowed
2026-01-10 20:13:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/penco-locker-single-tier-18x18x72-1-door-assembled-gray-2>: HTTP status code is not handled or not allowed
2026-01-10 20:14:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21-step-steel-caged-walk-through-fixed-access-ladder-gray-wlfc1221>: HTTP status code is not handled or not allowed
2026-01-10 20:14:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o--ring-127x43-jbj2-6>: HTTP status code is not handled or not allowed
2026-01-10 20:14:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s1-safety-quick-coupling-3-8-industrial-interchange-with-1-2-hose-barb-connection>: HTTP status code is not handled or not allowed
2026-01-10 20:14:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-6w-x-12l-6-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-chrome-18w-x-30l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shutter-24-exhaust-fan>: HTTP status code is not handled or not allowed
2026-01-10 20:14:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermostats-46-1390-apw2067700>: HTTP status code is not handled or not allowed
2026-01-10 20:14:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-3-hp-roof-ventilator>: HTTP status code is not handled or not allowed
2026-01-10 20:14:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gusseted-poly-bags-12w-x-10d-x-24h-3-mil-clear-250pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hard-master-jaws-for-bison-scroll-chuck-6-inch-3-jaw-3-piece-set>: HTTP status code is not handled or not allowed
2026-01-10 20:14:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-15w-x-18l-2-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-nexelon-24w-x-60l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crimping-tools-1005>: HTTP status code is not handled or not allowed
2026-01-10 20:14:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-mill-holder-r8-shank-1>: HTTP status code is not handled or not allowed
2026-01-10 20:14:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-mill-holder-nst-nmtb-40-shank-1-2-inch-type-7620-40-1-2-2-qc>: HTTP status code is not handled or not allowed
2026-01-10 20:14:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18378 pages (at 102 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:14:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/assembly-fastening-kits-m-47>: HTTP status code is not handled or not allowed
2026-01-10 20:14:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bissell-biggreen-commercial-bg21-manual-sweeper>: HTTP status code is not handled or not allowed
2026-01-10 20:14:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gusseted-poly-bags-20w-x-16d-x-42h-3-mil-clear-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-jhs1100-121>: HTTP status code is not handled or not allowed
2026-01-10 20:14:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bioair-plus-air-scrubber-negative-air-machine-dual-uvc-lights-ionization-600-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:14:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/id--warn-lbl-jhs2200-id>: HTTP status code is not handled or not allowed
2026-01-10 20:14:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gravity-flow-carton-rack-additional-level-2>: HTTP status code is not handled or not allowed
2026-01-10 20:14:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-chrome-18w-x-60l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gravity-flow-carton-rack-additional-level-3>: HTTP status code is not handled or not allowed
2026-01-10 20:14:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0-470-10mm-x-0005-0-01mm-ids-digimatic-thickness-gage-deep-throat-type>: HTTP status code is not handled or not allowed
2026-01-10 20:14:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0-8-200mm-x-001-0-1mm-mycal-lite-digital-caliper-non-output>: HTTP status code is not handled or not allowed
2026-01-10 20:14:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-no-690-power-drive-tri-stand-chain-vise-18-2-12>: HTTP status code is not handled or not allowed
2026-01-10 20:14:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-5w-x-15l-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a12p24-panel-nema-12-900x2100-fits-12x24-steelwhite>: HTTP status code is not handled or not allowed
2026-01-10 20:14:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-galvanized-clipper-carded-hooks>: HTTP status code is not handled or not allowed
2026-01-10 20:14:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lp2360-landscape-panels-inline8482-fits-230x600mm>: HTTP status code is not handled or not allowed
2026-01-10 20:14:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-tubing-4w-x-2150l-2-mil-clear-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:14:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fsman1-micro-lacer-face-strip-with-1-lacer-pin>: HTTP status code is not handled or not allowed
2026-01-10 20:14:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/001-x-1-2-dial-thickness-gage-4-dia-flat-anvil-ceramic-anvils>: HTTP status code is not handled or not allowed
2026-01-10 20:14:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-chrome-21w-x-72l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-poly-z-brite-18w-x-42l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-drawer-tool-cart>: HTTP status code is not handled or not allowed
2026-01-10 20:14:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-nexelon-21w-x-72l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-add-on-unit-5-tier-poly-z-brite-21w-x-30l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosed-three-phase-disconnect-manual-motor-controller>: HTTP status code is not handled or not allowed
2026-01-10 20:14:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-no-rj-99-roller-head-pipe-stands-12-max-pipe-capacity-32-55-h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-od-polyurethane-tubing-black-color-100-roll-125-200-psi>: HTTP status code is not handled or not allowed
2026-01-10 20:14:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-24-inch-adjustable-height-steel-work-platform-5inh-to-8inh-mcos72245>: HTTP status code is not handled or not allowed
2026-01-10 20:14:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-ventilated-locker-double-tier-12x15x36-6-door-assembled-2>: HTTP status code is not handled or not allowed
2026-01-10 20:14:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-300-compact-power-threading-machines-67182>: HTTP status code is not handled or not allowed
2026-01-10 20:14:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-ventilated-locker-double-tier-15x18x36-6-door-assembled-2>: HTTP status code is not handled or not allowed
2026-01-10 20:14:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-polyethylene-bags-16w-x-30l-6-mil-clear-250pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-step-16in-w-30in-d-top-step-steel-rolling-ladder-perforated-tread-no-handrail-kdsr003166-d3>: HTTP status code is not handled or not allowed
2026-01-10 20:14:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-no-915-roll-groover-w2-6-schedule-10-roll-set>: HTTP status code is not handled or not allowed
2026-01-10 20:14:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ck40-311-contactor-3-pole-460v>: HTTP status code is not handled or not allowed
2026-01-10 20:14:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-mm-od-polyurethane-tubing-blue-color-100-roll-125-200-psi>: HTTP status code is not handled or not allowed
2026-01-10 20:14:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/locking-storage-cabinet-clear-door-48x24x78-with-20-removable-bins-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:14:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ck23-311-contactor-3-pole-460v>: HTTP status code is not handled or not allowed
2026-01-10 20:14:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-poly-z-brite-18w-x-36l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-gas-infrared-heater-093550ngs-straight-configuration-50-l-150000-btu>: HTTP status code is not handled or not allowed
2026-01-10 20:14:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-no-310m-300-series-plumbing-bender-10mm-tube-size-42mm-bend-radius>: HTTP status code is not handled or not allowed
2026-01-10 20:14:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-threading-metal-cases-38605>: HTTP status code is not handled or not allowed
2026-01-10 20:14:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f44we90-elbow-90-deg-400x400-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 20:14:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/disconnect-switch-30-amp-4-pole-back-panel-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:14:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shovels-52315>: HTTP status code is not handled or not allowed
2026-01-10 20:14:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spd-lever-ghd-2020pf-2401075>: HTTP status code is not handled or not allowed
2026-01-10 20:14:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hndl-hd-stock-3268219>: HTTP status code is not handled or not allowed
2026-01-10 20:14:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-sprng-vbs-1610-2040>: HTTP status code is not handled or not allowed
2026-01-10 20:14:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f44t148gvp-straight-section-type-1-400x400x4800-galvgray>: HTTP status code is not handled or not allowed
2026-01-10 20:14:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a16p14-panel-junction-box-1475x1288-fits-16x14-steelwhite>: HTTP status code is not handled or not allowed
2026-01-10 20:14:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magnetic-corner-bumper-guard-b-plus-edge-39-inches-long-by-2inches-wide-blk-ylw-60-6889>: HTTP status code is not handled or not allowed
2026-01-10 20:14:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-nexelon-21w-x-72l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:14:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/disposable-polypropylene-coverall-elastic-wrists-ankles-hood-boots-white-large-25-case>: HTTP status code is not handled or not allowed
2026-01-10 20:14:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cca16169-compact8482-cast-junction-box-type-4x-160x160x90mm>: HTTP status code is not handled or not allowed
2026-01-10 20:14:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torque-multiplier-2200-ft-lbs-19-19-32-inch-long>: HTTP status code is not handled or not allowed
2026-01-10 20:14:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-bulk-box-12-bushel-truck-steel-chassis-base-red>: HTTP status code is not handled or not allowed
2026-01-10 20:14:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contact-adhesive-water-based-gallon>: HTTP status code is not handled or not allowed
2026-01-10 20:14:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/897-filament-tape-2-x-60-yds-6-mil-clear-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/minigrip-reclosable-lab-guard-uv-protection-bags-4w-x-6l-3-mil-amber-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/897-filament-tape-34-x-60-yds-6-mil-clear-12pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dark-blue-cap-style-4-point-ratchet-suspension-hard-hat>: HTTP status code is not handled or not allowed
2026-01-10 20:14:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-no-836-aluminum-straight-pipe-wrench-36>: HTTP status code is not handled or not allowed
2026-01-10 20:14:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-with-hang-hole-5w-x-8l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-no-768-adjustable-wrenches-18-adjustable-2-18-pipe-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:14:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gear-30t-ghb-1340-4237>: HTTP status code is not handled or not allowed
2026-01-10 20:14:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-step-roll-fold-steel-rolling-ladder-perforated-tread>: HTTP status code is not handled or not allowed
2026-01-10 20:14:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/salerno-series-high-back-light-blue-mesh-office-chair>: HTTP status code is not handled or not allowed
2026-01-10 20:14:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-desk-cherry-modular-office-furniture-1>: HTTP status code is not handled or not allowed
2026-01-10 20:14:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/venture-ii-eyewear-amber-lens-with-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:14:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/venture-ii-eyewear-3-0-ir-filter-lens-with-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:14:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/163-sjtw-8ft-heavy-duty-extension-cord-gg-13708-lighted-end>: HTTP status code is not handled or not allowed
2026-01-10 20:14:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/163-sjtw-8ft-3-outlet-heavy-duty-extension-cord-gg-15008-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:14:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-oz-bottle-super-lube-air-tool-lubricant>: HTTP status code is not handled or not allowed
2026-01-10 20:14:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-mobile-refreshment-center-black-2>: HTTP status code is not handled or not allowed
2026-01-10 20:14:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quik-dry-adapter-uni-snap-for-14-18-blades-sw21215>: HTTP status code is not handled or not allowed
2026-01-10 20:14:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-gusseted-poly-bags-8w-x-4d-x-12h-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1400-strapping-tape-1-x-60-yds-43-mil-clear-12pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-oz-tube-super-lube-silicone-lubricating-grease-with-ptfe>: HTTP status code is not handled or not allowed
2026-01-10 20:14:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gusseted-poly-bags-23w-x-17d-x-46h-4-mil-clear-50pack>: HTTP status code is not handled or not allowed
2026-01-10 20:14:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-w-x-15-d-workbench-lower-shelf-black>: HTTP status code is not handled or not allowed
2026-01-10 20:14:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-gal-bottle-super-lube-synthetic-gear-oil-iso-220>: HTTP status code is not handled or not allowed
2026-01-10 20:15:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-parcelsentry-freestanding-mailparcel-box-wf-pb007-black>: HTTP status code is not handled or not allowed
2026-01-10 20:15:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-milligram-leaf-weights-nist-class-f-with-traceable-certificate-20-mgs>: HTTP status code is not handled or not allowed
2026-01-10 20:15:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1400-strapping-tape-12-x-60-yds-43-mil-clear-72pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/46000-1-4-28-sae-lt-grease-fitting-straight-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-cylindrical-weights-nist-class-f-5-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:15:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gusseted-poly-bags-20w-x-18d-x-36h-4-mil-clear-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-cylindrical-weights-nist-class-f-5-grams>: HTTP status code is not handled or not allowed
2026-01-10 20:15:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-full-brim-style-4-point-ratchet-suspension-hard-hat>: HTTP status code is not handled or not allowed
2026-01-10 20:15:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fixed-base-100179>: HTTP status code is not handled or not allowed
2026-01-10 20:15:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cam-bdb-1340-4729>: HTTP status code is not handled or not allowed
2026-01-10 20:15:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-gal-pail-grommet-lube>: HTTP status code is not handled or not allowed
2026-01-10 20:15:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-lb-pail-super-lube-synthetic-grease-nlgi-1>: HTTP status code is not handled or not allowed
2026-01-10 20:15:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enriched-foam-hand-soap-with-moisturizers-800ml-fg750517>: HTTP status code is not handled or not allowed
2026-01-10 20:15:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/turbotoe-steel-toe-cap-overshoe-med-8-11-flexible-pliable-pvc-antislip-sole-waterproof>: HTTP status code is not handled or not allowed
2026-01-10 20:15:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/taper-bearing-ref-37--1230-5232851>: HTTP status code is not handled or not allowed
2026-01-10 20:15:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18473 pages (at 95 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:15:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-giant-stackable-storage-bin-18-1-4x29-7-8x12-red>: HTTP status code is not handled or not allowed
2026-01-10 20:15:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72in-x-12in-metal-shelf>: HTTP status code is not handled or not allowed
2026-01-10 20:15:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guide-plate-assy-1360-2900440>: HTTP status code is not handled or not allowed
2026-01-10 20:15:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-vinyl-braided-rope-59in-with-ends-for-portable-gold-post>: HTTP status code is not handled or not allowed
2026-01-10 20:15:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/taco-006-series-flanged-cast-iron-circulator-115v-ifc>: HTTP status code is not handled or not allowed
2026-01-10 20:15:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-aluminum-half-pallet-24x24>: HTTP status code is not handled or not allowed
2026-01-10 20:15:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drop-gravity-flow-roller-track-36-dx9-w-1>: HTTP status code is not handled or not allowed
2026-01-10 20:15:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jaw-inserts-wscrews-1435-2900850>: HTTP status code is not handled or not allowed
2026-01-10 20:15:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-replacement-fan-guard-for-washdown-fans>: HTTP status code is not handled or not allowed
2026-01-10 20:15:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/venture-ii-eyewear-clear-anti-fog-lens-with-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:15:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mounting-bracket-for-pak-sfl-pak-sfldmb>: HTTP status code is not handled or not allowed
2026-01-10 20:15:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-dog-house->: HTTP status code is not handled or not allowed
2026-01-10 20:15:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/goop-hand-cleaner-creme-4-5-lb-can-6>: HTTP status code is not handled or not allowed
2026-01-10 20:15:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/resealable-warning-poly-bags-w-vent-holes-10w-x-15l-15-mil-clear-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cabinets-fs-357-g-storage-cabinet-assembled-30x15x72-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:15:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hon-310-series-4-drawer-vertical-file-26-d-legal-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:15:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cabinets-bca-364213-p-bookcase-assembled-36x13x42-putty>: HTTP status code is not handled or not allowed
2026-01-10 20:15:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/444-double-coated-film-tape-2-x-36-yds-4-mil-clear-6pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cabinets-fs-227-p-storage-cabinet-assembled-27x15x72-putty>: HTTP status code is not handled or not allowed
2026-01-10 20:15:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-hanford-twin-post-no-support-brace-with-ornate-base-e1-economy-mailbox>: HTTP status code is not handled or not allowed
2026-01-10 20:15:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprng-jsg-9121ns-730215>: HTTP status code is not handled or not allowed
2026-01-10 20:15:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-cabinets-bca-364213-b-bookcase-assembled-36x13x42-black>: HTTP status code is not handled or not allowed
2026-01-10 20:15:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-scale-truck-pallet-scale-jack-with-weight-indicator-4400-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:15:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/warn-works-pullzall-handheld-110v-ac-electric-portable-pulling-li-ing-tool>: HTTP status code is not handled or not allowed
2026-01-10 20:15:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-hanford-triple-post-only-with-support-brace-with-ornate-base>: HTTP status code is not handled or not allowed
2026-01-10 20:15:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/business-card-refill-pages-holds-200-cards-clear-20-cards-sheet-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4016-double-sided-foam-tape-34-x-36-yds-625-mil-natural>: HTTP status code is not handled or not allowed
2026-01-10 20:15:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/offices-to-go-2-shelf-bookcase-in-walnut-executive-modular-furniture>: HTTP status code is not handled or not allowed
2026-01-10 20:15:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/offices-to-go-visual-board-cabinet-48-wx48d-walnut>: HTTP status code is not handled or not allowed
2026-01-10 20:15:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6802z-trapper-hat-zippered-black-l-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:15:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acroprint-es700-electronic-time-clock-and-document-stamp>: HTTP status code is not handled or not allowed
2026-01-10 20:15:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-foot-x-20-foot-super-heavy-duty-brown-tarp>: HTTP status code is not handled or not allowed
2026-01-10 20:15:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-w-x-36-d-production-workbench-maple-butcher-block-safety-edge-complete-bench-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:15:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-pocket-oak-wall-rack-medium-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:15:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5925-double-sided-foam-tape-1-x-5-yds-25-mil-black>: HTTP status code is not handled or not allowed
2026-01-10 20:15:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-iso-metric-roller-chain-32b-1-2-pitch-offset-link>: HTTP status code is not handled or not allowed
2026-01-10 20:15:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprng-5051081>: HTTP status code is not handled or not allowed
2026-01-10 20:15:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-roller-chain-25-1r-1-4-pitch-10ft-box>: HTTP status code is not handled or not allowed
2026-01-10 20:15:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cross-screw-1230r-5232261>: HTTP status code is not handled or not allowed
2026-01-10 20:15:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cardboard-corrugated-boxes-16-x-10-x-5-200-ect-32-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-bariatric-medical-reception-chair-vinyl-black>: HTTP status code is not handled or not allowed
2026-01-10 20:15:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/044-2393-dc-1u-1u-horizontal-wire-manager-closed-design>: HTTP status code is not handled or not allowed
2026-01-10 20:15:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-x-24-x-24-standard-shop-stand-maple-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:15:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electronic-packaging-workbench-plastic-square-edge-60-x-30-with-lower-shelf-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:15:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-x-24-x-36-drawer-shelf-shop-stand-shop-top-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:15:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/243-1949-10h-hdmi-male-to-male-w-internet-1080p-30-awg-10-ft-gold-plated-black>: HTTP status code is not handled or not allowed
2026-01-10 20:15:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-36-x-30-drawer-shelf-shop-stand-maple-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:15:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hl400-lpf-refill-dispenser-refill-canister-t-shape-2-canisters-800-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:15:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clean-and-strip-xt-pro-disc-t27-4-1-2-x-7-8-in-s-xcs-10-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:15:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/max-lite-lpf-ls4-refill-dispenser-refill-t-shape-10-bags-2000-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:15:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-double-roller-chain-80-2r-1-pitch-100ft-reel>: HTTP status code is not handled or not allowed
2026-01-10 20:15:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washer-mdl-ghbbdb-1340a-5707>: HTTP status code is not handled or not allowed
2026-01-10 20:15:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-0513b-10xl-cut-resistant-gloves-nitrile-micro-foam-coating-a4-d-size-10>: HTTP status code is not handled or not allowed
2026-01-10 20:15:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gear-225m-325m-25m-24t-ghbbdb-1340a-5718>: HTTP status code is not handled or not allowed
2026-01-10 20:15:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smooth-paper-clips-wire-jumbo-silver-100box>: HTTP status code is not handled or not allowed
2026-01-10 20:15:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergency-stop-1050evs-sb1>: HTTP status code is not handled or not allowed
2026-01-10 20:15:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-0513w-8m-cut-resistant-gloves-nitrile-micro-foam-coating-a4-d-size-8>: HTTP status code is not handled or not allowed
2026-01-10 20:15:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flap-disc-769f-05919-t27-5-x-7-8-in-80-yf-weight-10-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:15:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-foot-x-12-foot-high-visibility-orange-tarp>: HTTP status code is not handled or not allowed
2026-01-10 20:15:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mini-binder-clips-steel-wire-14-capacity-12-wide-blacksilver-144pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-stacking-bin-6-x-9-1-4-x-5-green>: HTTP status code is not handled or not allowed
2026-01-10 20:15:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-key-4x4x12-jvm836-44>: HTTP status code is not handled or not allowed
2026-01-10 20:15:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-double-roller-chain-25-2r-1-4-pitch-offset-link>: HTTP status code is not handled or not allowed
2026-01-10 20:15:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21-inch-black-rubber-tarp-strap-packs-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:15:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-filter-access-door-for-761217-761218>: HTTP status code is not handled or not allowed
2026-01-10 20:15:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-jtm-4vs-key6645>: HTTP status code is not handled or not allowed
2026-01-10 20:15:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-foot-x-32-foot-blue-tarp>: HTTP status code is not handled or not allowed
2026-01-10 20:15:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-foot-x-48-foot-blue-tarp>: HTTP status code is not handled or not allowed
2026-01-10 20:15:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-cottered-pin-roller-chain-160-1c-2-pitch-10ft-box>: HTTP status code is not handled or not allowed
2026-01-10 20:15:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-storage-cabinet-30-w-x-18-d-x-72-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:15:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-roller-chain-240-1r-3-pitch-offset-link>: HTTP status code is not handled or not allowed
2026-01-10 20:15:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-foot-x-8-foot-camouflage-green-tarp>: HTTP status code is not handled or not allowed
2026-01-10 20:15:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-precision-ansi-double-roller-chain-35-2r-3-8-pitch-100ft-reel>: HTTP status code is not handled or not allowed
2026-01-10 20:15:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-island-bench-black-double-door-6x2>: HTTP status code is not handled or not allowed
2026-01-10 20:15:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/four-station-workbench-4-vises>: HTTP status code is not handled or not allowed
2026-01-10 20:15:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/resealable-poly-bags-12w-x-12l-15-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rociaplanar-led-industrial-task-light-dimming-art-arm-100-240v-18w>: HTTP status code is not handled or not allowed
2026-01-10 20:15:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/41420-nylon-blast-suit-blue-small-nylon-cotton>: HTTP status code is not handled or not allowed
2026-01-10 20:15:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scroll-mount-address-post-no-base-with-horsehead-finial>: HTTP status code is not handled or not allowed
2026-01-10 20:15:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bearing-cap-jtm-124vs-lk-029>: HTTP status code is not handled or not allowed
2026-01-10 20:15:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-8w-x-30l-4-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 20:15:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40096-60-grit-aluminum-oxide-4-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:15:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/halux-universal-led-treatment-light-n50-1-p-fx-double-arm-clamp>: HTTP status code is not handled or not allowed
2026-01-10 20:15:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40094-150-grit-aluminum-oxide-4-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:15:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-8w-x-5l-4-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:16:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gondola-free-standing-slider-system-with-36-bins-ivory>: HTTP status code is not handled or not allowed
2026-01-10 20:16:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-manual-pallet-jack-gwk-bs55-lw-fits-bishamon-model-bs55>: HTTP status code is not handled or not allowed
2026-01-10 20:16:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unsupported-6-step-30-inch-cantilever-ladder-grip-strut>: HTTP status code is not handled or not allowed
2026-01-10 20:16:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cantilever-rack-single-sided-upright-23>: HTTP status code is not handled or not allowed
2026-01-10 20:16:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprng-pin-jtm-1055-jtm1055-v45-1>: HTTP status code is not handled or not allowed
2026-01-10 20:16:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-electric-pallet-jack-gwk-df25-lw-fits-noble-lift-model-df25>: HTTP status code is not handled or not allowed
2026-01-10 20:16:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/41909-small-parts-container-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:16:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4001244-bottle-blaster-80-110-cast-aluminum-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:16:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/resealable-poly-bags-9w-x-12l-4-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 20:16:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-manual-pallet-jack-gwk-l50mp-lw-fits-lift-rite-model-l50-mini>: HTTP status code is not handled or not allowed
2026-01-10 20:16:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brake-lock-block-jtm-1050-pvs-054>: HTTP status code is not handled or not allowed
2026-01-10 20:16:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gondola-free-standing-slider-system-with-56-bins-ivory>: HTTP status code is not handled or not allowed
2026-01-10 20:16:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mounting-clamp-for-ald-led-task-light-for-pin-mount-35-span>: HTTP status code is not handled or not allowed
2026-01-10 20:16:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40207-moisture-separator-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:16:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-folding-machine-500-sheets-capacity-252456>: HTTP status code is not handled or not allowed
2026-01-10 20:16:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shaft-jjp8bt-93>: HTTP status code is not handled or not allowed
2026-01-10 20:16:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18574 pages (at 101 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:16:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-scoop-white>: HTTP status code is not handled or not allowed
2026-01-10 20:16:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/value-1-stream-half-round-satin-black-16-gal-trash-t1899v>: HTTP status code is not handled or not allowed
2026-01-10 20:16:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-12w-x-36l-4-mil-clear-250pack>: HTTP status code is not handled or not allowed
2026-01-10 20:16:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/value-single-stream-bronze-vein-15-gal-mixed-recycle-m-1242>: HTTP status code is not handled or not allowed
2026-01-10 20:16:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/value-single-stream-satin-black-satin-brass-41-gal-waste-w-2042>: HTTP status code is not handled or not allowed
2026-01-10 20:16:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/45-qt-1-4-size-steam-table-pan-anti-jam-23-ga>: HTTP status code is not handled or not allowed
2026-01-10 20:16:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sloped-rim-trays-15-alum-pizza-tray-040-thick>: HTTP status code is not handled or not allowed
2026-01-10 20:16:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/143-925-screw-assy-lock-1-2695023>: HTTP status code is not handled or not allowed
2026-01-10 20:16:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tarifold-vertical-hanging-pocket-5-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:16:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-14w-x-10l-4-mil-clear-500pack>: HTTP status code is not handled or not allowed
2026-01-10 20:16:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-diamond-grip-rubber-runner-mats-2mm-x-4-x-15-rubber-flooring-rolls-black>: HTTP status code is not handled or not allowed
2026-01-10 20:16:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-diamond-grip-rubber-runner-mats-2mm-x-4-x-20-rubber-flooring-rolls-black>: HTTP status code is not handled or not allowed
2026-01-10 20:16:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/upright-vaccine-refrigerator-8-cubic-ft-cap-wire-shelves-solid-door>: HTTP status code is not handled or not allowed
2026-01-10 20:16:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-diamond-grip-rubber-runner-mats-2mm-x-4-x-6-rubber-flooring-rolls-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:16:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11605-hose-rubber>: HTTP status code is not handled or not allowed
2026-01-10 20:16:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40249-cloth-lined-blast-gloves-premium-rubber>: HTTP status code is not handled or not allowed
2026-01-10 20:16:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/719201-extension-bed-for-jwl-1221vs>: HTTP status code is not handled or not allowed
2026-01-10 20:16:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/resealable-polypropylene-bags-3l-x-2w-15-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:16:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbl-mesh-strainer-7-1-4-med>: HTTP status code is not handled or not allowed
2026-01-10 20:16:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polypropylene-union-elbow>: HTTP status code is not handled or not allowed
2026-01-10 20:16:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speakman-anystream-3-3-4-dia-caspian-wall-mount-showerhead-brushed-nickel-finish-2-gpm>: HTTP status code is not handled or not allowed
2026-01-10 20:16:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speakman-anystream-alexandria-wall-mount-showerhead-polished-chrome-finish-2-gpm>: HTTP status code is not handled or not allowed
2026-01-10 20:16:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-liquid-level-display-tube-mountin-261990-641250-641263-641407-floor-scrubbers>: HTTP status code is not handled or not allowed
2026-01-10 20:16:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/composite-extruder-for-method>: HTTP status code is not handled or not allowed
2026-01-10 20:16:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-28w-x-28l-4-mil-clear-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:16:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pivot-708020-107>: HTTP status code is not handled or not allowed
2026-01-10 20:16:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s2mt250-tube-250-mm-28-lbs-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:16:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e1pb-push-button-encl-1pb-x-305mm-350x325x275-in>: HTTP status code is not handled or not allowed
2026-01-10 20:16:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-conductor-unshielded-plenum-cable-2-conductor-16-awg-19-0117-bc-natural>: HTTP status code is not handled or not allowed
2026-01-10 20:16:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-athletic-sneakers-water-and-oil-resistant-size-13m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:16:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lever-stainless-steel-high-viscosity-pump>: HTTP status code is not handled or not allowed
2026-01-10 20:16:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-polypropylene-bags-8l-x-6w-2-mil-clear-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:16:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-slip-on-shoes-size-9m-white>: HTTP status code is not handled or not allowed
2026-01-10 20:16:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o-ring-107x15-jsm3330-11>: HTTP status code is not handled or not allowed
2026-01-10 20:16:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-sand-screen-disc-80-grit-10-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:16:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-slip-on-shoes-size-105m-white>: HTTP status code is not handled or not allowed
2026-01-10 20:16:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-removable-foam-tape-12-x-36-yds-625-mil-white-24pack>: HTTP status code is not handled or not allowed
2026-01-10 20:16:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-polishing-17-white-800-grit-deep-cleaning-pad-2-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:16:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ratchet-anvil-12-jsm3430-38>: HTTP status code is not handled or not allowed
2026-01-10 20:16:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-slip-on-shoes-size-12m-white>: HTTP status code is not handled or not allowed
2026-01-10 20:16:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-extinguisher-sign-glow-acrylic-5-3-4-x-8-3-4>: HTTP status code is not handled or not allowed
2026-01-10 20:16:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a603624fsg-free-stand-singledual-access-type-12-6006x3606x2406-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 20:16:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silent-air-industrial-plus-10-hp-3-phase-80-gal-vertical-compressor-58-cfm-dryer-bundle>: HTTP status code is not handled or not allowed
2026-01-10 20:16:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-drum-tap-spring-loaded-push>: HTTP status code is not handled or not allowed
2026-01-10 20:16:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-floor-mount-safety-bollard-4-1-2-dia-x-48-h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:16:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a30r308hcr-hinged-cover-medium-type-3r-3000x3000x800-galvanizedpaint>: HTTP status code is not handled or not allowed
2026-01-10 20:16:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optiloc-3-sections-14>: HTTP status code is not handled or not allowed
2026-01-10 20:16:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/downrod-8-wh-color-for-cp48d-cp56d-cp60d-with-lead-wire-and-safety-cable>: HTTP status code is not handled or not allowed
2026-01-10 20:16:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dust-barrier-fastener-plastic-metal-red-ms4>: HTTP status code is not handled or not allowed
2026-01-10 20:16:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-tapeless-seal-aluminum-foam-silver-black-spn>: HTTP status code is not handled or not allowed
2026-01-10 20:16:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/command-hub-field-retrofit-kit-for-upgrade-of-dehumidifiers>: HTTP status code is not handled or not allowed
2026-01-10 20:16:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-tampico-floor-brush-head-24>: HTTP status code is not handled or not allowed
2026-01-10 20:16:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-loaded-dust-barrier-secure-poles-anodized-aluminum-red-kt20>: HTTP status code is not handled or not allowed
2026-01-10 20:16:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-loaded-pole-kit-anodized-aluminum-silver-slp6>: HTTP status code is not handled or not allowed
2026-01-10 20:16:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/packing-workbench-plastic-safety-edge-with-electric-72-x-36-with-lower-shelf-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:16:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/renegade-mixed-recycling-container-50-gallon-capacity-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:16:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pin-wrench-jsm-6195b-sm-619554>: HTTP status code is not handled or not allowed
2026-01-10 20:16:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lever-action-drum-pump-for-strong-acids-alkali-solutions>: HTTP status code is not handled or not allowed
2026-01-10 20:16:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/csd16128w-concept-wall-mount-enclwindow-1600x1200x800-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 20:16:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-umbrella-w-tilt-mechanism-olefin-fabric-8-1-2-w-royal-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:16:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/janitorial-shadow-board-combo-kit-green-on-black-industrial-grade-aluminum-sbk103al>: HTTP status code is not handled or not allowed
2026-01-10 20:16:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-plastic-garbage-can-with-lid-dolly-20-gal-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:16:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/madera-elongated-flushometer-valve-toilet-1>: HTTP status code is not handled or not allowed
2026-01-10 20:16:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lucerne-wall-hung-sink-2>: HTTP status code is not handled or not allowed
2026-01-10 20:16:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/urine-digester-with-odor-neutralizer-lemon-gallon-bottle-4-bottles-case>: HTTP status code is not handled or not allowed
2026-01-10 20:16:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washer-jsm-6196195b-sm-61944>: HTTP status code is not handled or not allowed
2026-01-10 20:16:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-ss-316-cast-reducing-coupling-2-12-x-1-npt-female>: HTTP status code is not handled or not allowed
2026-01-10 20:16:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prosegur-mini-patriot-tag-2-alarm-with-lanyard-standard-lock-58-khz-black-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:16:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commode-floor-guard-mat-urinal-mount-fresh-scent-6-case>: HTTP status code is not handled or not allowed
2026-01-10 20:16:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/set-screw-jsm-704-sm-70438>: HTTP status code is not handled or not allowed
2026-01-10 20:16:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/651-butoflex-chemical-resistant-butyl-gloves-20-mil-14-l-size-9-651319>: HTTP status code is not handled or not allowed
2026-01-10 20:16:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterhog-fashion-diamond-mat-charcoal-4-x-10>: HTTP status code is not handled or not allowed
2026-01-10 20:16:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/o-ring-98x19-70109npn>: HTTP status code is not handled or not allowed
2026-01-10 20:16:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/memory-foam-seat-rest-14-1-2w-x-13-1-2d-x-2h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:16:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/janitorial-shadow-board-blue-on-black-industrial-grade-aluminum-sb101al>: HTTP status code is not handled or not allowed
2026-01-10 20:16:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-performance-200-series-lan-station-w-full-bottom-shelf-folkstone-melamine>: HTTP status code is not handled or not allowed
2026-01-10 20:16:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/asg18x18x6nk-pull-box-screw-cover-1800x1800x600-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 20:16:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dumpster-deodorizing-cleaning-kit-citrus-scent-1-gal-dilution-ratio>: HTTP status code is not handled or not allowed
2026-01-10 20:16:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fae-5005-refill-sterile-gauze-pads-3x3-10-per-bag>: HTTP status code is not handled or not allowed
2026-01-10 20:16:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dx-power-workstation-hutch-roller-cabinet-41w-x-25dorange-wblack-handles-trim>: HTTP status code is not handled or not allowed
2026-01-10 20:16:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nl52-stanzoil-neoprene-gloves-14-l-medium-weight-1-pair-size-10-337420>: HTTP status code is not handled or not allowed
2026-01-10 20:16:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spacer-64-saw-6290660>: HTTP status code is not handled or not allowed
2026-01-10 20:17:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-ss-316-cast-hex-bushing-12-x-38-npt-male-x-female>: HTTP status code is not handled or not allowed
2026-01-10 20:17:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fae-6003-first-aid-tape-1-2x-5-yd-and-conforming-gauze-bandage-roll-2-1-per-box>: HTTP status code is not handled or not allowed
2026-01-10 20:17:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-oz-wall-block-with-hanger-cherry-scent-6-case>: HTTP status code is not handled or not allowed
2026-01-10 20:17:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nut-jsm-516-51621>: HTTP status code is not handled or not allowed
2026-01-10 20:17:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-259-3-4-pneumatic-impact>: HTTP status code is not handled or not allowed
2026-01-10 20:17:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterhog-fashion-mat-med-brown-3-x-5>: HTTP status code is not handled or not allowed
2026-01-10 20:17:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/no-butts-smoking-shelters-back-to-wall-4-sided-3-6-x-10-4>: HTTP status code is not handled or not allowed
2026-01-10 20:17:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx-top-chest-roller-cabinet-combo-41w-x-25d-x-64-58h-blue-with-chrome-dr-pulls>: HTTP status code is not handled or not allowed
2026-01-10 20:17:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cursor-hf2-112>: HTTP status code is not handled or not allowed
2026-01-10 20:17:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a12r126hclo-enclosurelift-off-hng-type-3r-1200x1200x600-galvanizedpaint>: HTTP status code is not handled or not allowed
2026-01-10 20:17:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-121-k6-air-hammer-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:17:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/post-it-super-sticky-note-pads-4x4-lined-asstd-colors-six-90-sheet-pads-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:17:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smiths-environmental-products-profile-fan-convector-40000-btu>: HTTP status code is not handled or not allowed
2026-01-10 20:17:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-313a-angle-sander>: HTTP status code is not handled or not allowed
2026-01-10 20:17:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e6pba-push-button-encl-sloped-front-6pb-x-305mm>: HTTP status code is not handled or not allowed
2026-01-10 20:17:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e20pba-push-button-encl-sloped-front-20pb-x-305mm>: HTTP status code is not handled or not allowed
2026-01-10 20:17:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18672 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:17:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bin-nestable-6-5-8-w-x-11-5-8-d-x-4-d-green>: HTTP status code is not handled or not allowed
2026-01-10 20:17:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/barrier-post-mirror>: HTTP status code is not handled or not allowed
2026-01-10 20:17:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a48n2512fslp-free-stand-1-door-encl-4800x2550x1200-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 20:17:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/journal-entry-notetaking-planner-pad-84-sheets-6-3-4-x-8-1-2>: HTTP status code is not handled or not allowed
2026-01-10 20:17:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brass-breather-valve-with-m18-x-1-5-thread-881-m18x1-5-200-ms-m>: HTTP status code is not handled or not allowed
2026-01-10 20:17:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cordless-grease-gun-kit-with-18v-lxt-3ah-lithium-ion-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:17:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a12n126-small-type-1-enclosure-1200x1200x600-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 20:17:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedi-boot-torpedo-end-register-vent-boot-w-adj-hangers-for-hvac-duct-work-6-x-10-x-6>: HTTP status code is not handled or not allowed
2026-01-10 20:17:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedi-boot-torpedo-end-register-vent-boot-w-adj-hangers-for-hvac-duct-work-4-x-10-x-5>: HTTP status code is not handled or not allowed
2026-01-10 20:17:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3m-double-coated-urethane-foam-tape-4056-black-1-x-36-yd-1-16-9-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:17:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-bookcase-34-1-2-w-x-13-d-x-42-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:17:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-shelf-bookcase-34-1-2-w-x-13-d-x-30-h-putty>: HTTP status code is not handled or not allowed
2026-01-10 20:17:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dx-side-locker-5-shelves-19w-x-21d-x-56-12h-matte-black-with-black-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:17:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a90xm7824ftclpg-heavy-duty-fs-disc-encl-wo-panel-2-door-9012x7850x2412-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:17:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx-pro-power-workstation-hutch-roller-cabinet-55w-x-25d-black-with-blue-dr-pulls>: HTTP status code is not handled or not allowed
2026-01-10 20:17:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-unit-5-tier-48w-x-18d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:17:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speedi-boot-wall-stack-register-vent-boot-w-adj-hangers-for-hvac-duct-work-6-x-12-x-7>: HTTP status code is not handled or not allowed
2026-01-10 20:17:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a60x4912lpftc-2-door-wfloor-stands-disc-encl-6012x4975x1212-paint>: HTTP status code is not handled or not allowed
2026-01-10 20:17:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bad-boy-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:17:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grease-fitting-6290317>: HTTP status code is not handled or not allowed
2026-01-10 20:17:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sirius-amber-lens-magnet-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:17:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/membrane-1632-6293265>: HTTP status code is not handled or not allowed
2026-01-10 20:17:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/horn-switch-wire-hook-up-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:17:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-galvanized-steel-load-stabilizer-2-o-d>: HTTP status code is not handled or not allowed
2026-01-10 20:17:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-12-union-fitting>: HTTP status code is not handled or not allowed
2026-01-10 20:17:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipe-2-od-x-19-316l>: HTTP status code is not handled or not allowed
2026-01-10 20:17:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a1008chs-continuous-hinge-wclamps-type-12-1150x894-in-steelgray>: HTTP status code is not handled or not allowed
2026-01-10 20:17:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-ke-thermaflex-flexible-hvac-duct-5-diameter-r8>: HTTP status code is not handled or not allowed
2026-01-10 20:17:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pressure-gauge-part-replacement-for-kerosene-heater>: HTTP status code is not handled or not allowed
2026-01-10 20:17:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fantastik-all-purpose-cleaner-pleasant-scent-1-gallon-bottle-4-case-682269>: HTTP status code is not handled or not allowed
2026-01-10 20:17:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/needle-depth-gauge-1020-169>: HTTP status code is not handled or not allowed
2026-01-10 20:17:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-view-greenhouse-kit-20w-x-107h-x-36l-natural-gas>: HTTP status code is not handled or not allowed
2026-01-10 20:17:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26x12x72-solar-star-greenhouse-w-poly-ends-and-drop-down-sides-prop-heater>: HTTP status code is not handled or not allowed
2026-01-10 20:17:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26x12x72-solar-star-greenhouse-w-solid-polycarbonate-gas-heater>: HTTP status code is not handled or not allowed
2026-01-10 20:17:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-km-thermaflex-flexible-hvac-duct-14-diameter-r4-2>: HTTP status code is not handled or not allowed
2026-01-10 20:17:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elite-wall-desk-single-size-manual-close-combination-lock-cherry>: HTTP status code is not handled or not allowed
2026-01-10 20:17:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laptop-wall-desk-combination-lock-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:17:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-computer-station-with-monitor-arm-36w-x-24d-x-33-1-2h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:17:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-animal-hut-61w-x-62h-x-122l>: HTTP status code is not handled or not allowed
2026-01-10 20:17:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60440106627-utility-cloth-sheet-314d-9w-x-11l-p180-grit>: HTTP status code is not handled or not allowed
2026-01-10 20:17:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shaft-model-201planer-6012055>: HTTP status code is not handled or not allowed
2026-01-10 20:17:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/majestic-greenhouse-20w-x-60l-drop-down-w-film>: HTTP status code is not handled or not allowed
2026-01-10 20:17:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-buna-n-pvc-strip-120-l-x-2-w-x-1-thick-black-acrylic-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 20:17:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-solid-galvanized-steel-shelving-add-on-unit-5-tier-72w-x-24d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:17:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classical-b-v-belt-b85>: HTTP status code is not handled or not allowed
2026-01-10 20:17:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprng-model-201planer-6012175>: HTTP status code is not handled or not allowed
2026-01-10 20:17:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30x12x36-solar-star-greenhouse-w-poly-ends-and-roll-up-sides>: HTTP status code is not handled or not allowed
2026-01-10 20:17:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classical-cogged-bx-v-belt-bx76>: HTTP status code is not handled or not allowed
2026-01-10 20:17:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrow-5vx-cogged-v-belt-5vx1000>: HTTP status code is not handled or not allowed
2026-01-10 20:17:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shaft-drive-pf3-48-6288948>: HTTP status code is not handled or not allowed
2026-01-10 20:17:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprayon-711-the-protector-lubricant-16-oz-aerosol>: HTTP status code is not handled or not allowed
2026-01-10 20:17:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-spindle-assembly-30105000i>: HTTP status code is not handled or not allowed
2026-01-10 20:17:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bearing-thrust-51107-6294308>: HTTP status code is not handled or not allowed
2026-01-10 20:17:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spectrum-quad-slim-recycling-station-for-organics-36-gal-cap-greenbluegrayblack>: HTTP status code is not handled or not allowed
2026-01-10 20:17:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knife-gauge-bar-60a-6296156>: HTTP status code is not handled or not allowed
2026-01-10 20:17:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-view-greenhouse-kit-26w-x-36l-natural-gas>: HTTP status code is not handled or not allowed
2026-01-10 20:17:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sko-bkt-oil-only-spill-kit65-gallon-bucket>: HTTP status code is not handled or not allowed
2026-01-10 20:17:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-rack-mobile-gear-storage-rack-locker-double-sided-six-24-sections-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:17:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spacer-model-201planer-6012177>: HTTP status code is not handled or not allowed
2026-01-10 20:17:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-rush-print-6l-x-4w-redblack-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:17:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ht555-high-traffic-universal-roll15w-x-150lheavy-weighttriple-perforated>: HTTP status code is not handled or not allowed
2026-01-10 20:17:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/34x12x72-solar-star-greenhouse-w-solid-polycarbonate-gas-heater>: HTTP status code is not handled or not allowed
2026-01-10 20:17:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-w-instructions-enclosed-print-5l-x-3w-fluorescent-yellow-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:17:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classical-cogged-ax-v-belt-ax44>: HTTP status code is not handled or not allowed
2026-01-10 20:17:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-silicone-sheet-12-l-x-12-w-x-1-8-thick-blue-detectable-60a-high-temp-adhesive>: HTTP status code is not handled or not allowed
2026-01-10 20:17:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/weathershield-commercial-canopy-18w-x-60l-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:17:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fabric-uphostered-restaurant-chair-with-ladder-back-burgundy-1>: HTTP status code is not handled or not allowed
2026-01-10 20:17:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magic-tape-refill-3-4-x-1000-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:17:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heat-seal-bubble-mailers-7-14-14w-x-20l-kraft-50pack>: HTTP status code is not handled or not allowed
2026-01-10 20:17:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-duty-steel-zinc-plated-wire-rope-thimble-3-8-diameter>: HTTP status code is not handled or not allowed
2026-01-10 20:17:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-combination-cabinet-easy-assembly-36x18x72-tan-269878tn>: HTTP status code is not handled or not allowed
2026-01-10 20:17:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peel-seal-glamour-mailers-9-12w-x-12-34l-translucent-silver-250pack>: HTTP status code is not handled or not allowed
2026-01-10 20:17:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26x12x72-solar-star-greenhouse-w-poly-ends-and-roll-up-sides>: HTTP status code is not handled or not allowed
2026-01-10 20:17:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26x12x72-solar-star-greenhouse-w-poly-top-and-ends-drop-down-sides-gas-heater>: HTTP status code is not handled or not allowed
2026-01-10 20:17:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30x12x36-solar-star-greenhouse-w-poly-top-and-ends-roll-up-sides>: HTTP status code is not handled or not allowed
2026-01-10 20:17:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pan-hd-screw-wflange-sf069300>: HTTP status code is not handled or not allowed
2026-01-10 20:17:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bubble-lined-poly-mailers-12-12w-x-19l-2-mil-white-50pack>: HTTP status code is not handled or not allowed
2026-01-10 20:17:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-wire-shelving-add-on-unit-5-tier-42w-x-21d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:17:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-sheet-96-l-x-48-w-x-1-8-thick-red-ps-cact-55>: HTTP status code is not handled or not allowed
2026-01-10 20:17:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-washer-18x38x132-6296123>: HTTP status code is not handled or not allowed
2026-01-10 20:17:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-green-wire-shelving-add-on-unit-5-tier-24w-x-18d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:18:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/weathershield-giant-commercial-canopy-24w-x-50l-green>: HTTP status code is not handled or not allowed
2026-01-10 20:18:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strain-relief-bushing-jbos-5-6286915>: HTTP status code is not handled or not allowed
2026-01-10 20:18:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sparta-spatula-w-plastic-handle-13-12>: HTTP status code is not handled or not allowed
2026-01-10 20:18:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-mailers-9w-x-12l-25-mil-white-1000pack>: HTTP status code is not handled or not allowed
2026-01-10 20:18:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500-3-8-diameter-7x19-galvanized-aircraft-cable-2>: HTTP status code is not handled or not allowed
2026-01-10 20:18:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indicator-pja-c41-15-planer-6284750>: HTTP status code is not handled or not allowed
2026-01-10 20:18:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-no-top-freight-print-10l-x-8w-fluorescent-yellow-roll-of-250>: HTTP status code is not handled or not allowed
2026-01-10 20:18:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-unilast-wheel-8x2-12-ball>: HTTP status code is not handled or not allowed
2026-01-10 20:18:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700356wht-pegboard-powerwing-display-1675w-x-60h-wh-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 20:18:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comfort-curve-bus-box-20-15-7grey>: HTTP status code is not handled or not allowed
2026-01-10 20:18:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topnotch-one-sixth-size-food-pan-6-2532-x-6-38black-4-deep>: HTTP status code is not handled or not allowed
2026-01-10 20:18:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-bar-48-l-x-1-w-x-1-8-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:18:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-mailers-with-tear-strip-24w-x-36l-25-mil-white-200pack>: HTTP status code is not handled or not allowed
2026-01-10 20:18:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/86757-out-of-service-production-tag-100pkg-cardstock-5-34w-x-3w>: HTTP status code is not handled or not allowed
2026-01-10 20:18:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/104314-toughstripe-floor-marking-tape-polyester-2w-x-100l-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:18:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-do-not-drop-print-3l-x-2w-redwhite-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:18:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48112-scaffold-status-holder-and-tags-plasticpolyester-3w-x-5-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:18:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18770 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:18:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-detent-6mm-model-201-planer-6012209>: HTTP status code is not handled or not allowed
2026-01-10 20:18:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guard-cutterhd-12-jointer-mdl-1285-6292595>: HTTP status code is not handled or not allowed
2026-01-10 20:18:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/480-400-8-lw-rib-tire>: HTTP status code is not handled or not allowed
2026-01-10 20:18:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-x-14-x-14-doublewall-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:18:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/480-400-8-garden-bar-lug-tire>: HTTP status code is not handled or not allowed
2026-01-10 20:18:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mailing-tubes-with-caps-2dia-x-20l-0060-thick-black-50pack>: HTTP status code is not handled or not allowed
2026-01-10 20:18:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/225530-cosmetic-tray-w24-slots-1025w-x-25h-x-3d-clr-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 20:18:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-bar-48-l-x-1-w-x-1-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 20:18:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-plastex-wheel-6x1-12-58-roller>: HTTP status code is not handled or not allowed
2026-01-10 20:18:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/redi-seal-envelopes-9-12w-x-12-12l-white-500pack>: HTTP status code is not handled or not allowed
2026-01-10 20:18:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-abs-tube-72-l-x-1-4-id-x-1-2-od-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:18:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-track-wheel-3-12x1-716-34-roller>: HTTP status code is not handled or not allowed
2026-01-10 20:18:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brake-fixed-base-jds-12bpds-12cs-612118>: HTTP status code is not handled or not allowed
2026-01-10 20:18:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-seal-bubble-mailers-4-9-12w-x-14-12l-kraft-100pack>: HTTP status code is not handled or not allowed
2026-01-10 20:18:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-inside-packages-comply-print-6l-x-4w-redwhite-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:18:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/222884-48-compartment-cosmetic-display-12w-x-145h-x-85d-clr-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 20:18:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gear-motor-assembly-180v-dc-2244pro3-407>: HTTP status code is not handled or not allowed
2026-01-10 20:18:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-seal-bubble-mailers-5-10-12w-x-16l-kraft-70pack>: HTTP status code is not handled or not allowed
2026-01-10 20:18:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelite-vented-plastic-shelving-starter-unit-5-tier-36w-x-24d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:18:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-dia-round-paper-labels-with-wed-print-fluorescent-orange-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:18:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-x-16-x-10-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:18:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-pvc-rectangular-tube-36-l-x-3-3-8-w-gray-bulk-rpt-pvc-41>: HTTP status code is not handled or not allowed
2026-01-10 20:18:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simonize-almond-pearl-pearlescent-lotion-hand-soap-gallon>: HTTP status code is not handled or not allowed
2026-01-10 20:18:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-petg-tube-24-l-x-1-2-id-x-5-8-od-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:18:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-20-x-12-doublewall-regular-slotted-container>: HTTP status code is not handled or not allowed
2026-01-10 20:18:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mouse-pad-wrist-support-with-microban-protection-graphite>: HTTP status code is not handled or not allowed
2026-01-10 20:18:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-abs-tube-24-l-x-1-id-x-1-1-4-od-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:18:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desktop-direct-thermal-labels-2w-x-1l-1-core-4od-white-12pack>: HTTP status code is not handled or not allowed
2026-01-10 20:18:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desktop-direct-thermal-labels-4w-x-1-12l-1-core-4od-white-12pack>: HTTP status code is not handled or not allowed
2026-01-10 20:18:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-heavy-duty-standard-threaded-hex-base-warning-whip-w-light-12-x11-orange-rectangle-flag>: HTTP status code is not handled or not allowed
2026-01-10 20:18:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700357pnk-pegboard-powerwing-display-16w-x-2025h-pk-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 20:18:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-petg-tube-72-l-x-1-4-id-x-3-8-od-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:18:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-support-plate-short-jwts-10-200205w>: HTTP status code is not handled or not allowed
2026-01-10 20:18:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9466t67-pulley-6646048>: HTTP status code is not handled or not allowed
2026-01-10 20:18:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/193732-triple-sided-sign-hlr-wrb-85-x-11-clr-1pack>: HTTP status code is not handled or not allowed
2026-01-10 20:18:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-silicone-strip-36-l-x-5-w-x-1-32-thick-blue-detectable-60a-bulk-rs-s60md-56>: HTTP status code is not handled or not allowed
2026-01-10 20:18:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-heavy-duty-standard-threaded-hex-base-warning-whip-w-light-12-x11-orange-rectangle-flag>: HTTP status code is not handled or not allowed
2026-01-10 20:18:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-polypropylene-liner-18x54>: HTTP status code is not handled or not allowed
2026-01-10 20:18:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-pvc-90-degree-angle-24-l-x-2-w-gray-bulk-pa-pvc-40>: HTTP status code is not handled or not allowed
2026-01-10 20:18:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/92a-4-lock-pin-6-x-22l-6288927>: HTTP status code is not handled or not allowed
2026-01-10 20:18:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/17-x-10-x-8-1-4-insulated-container>: HTTP status code is not handled or not allowed
2026-01-10 20:18:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-12-dia-round-inventory-circle-labels-dark-blue-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:18:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-48-inch-led-aluminum-shop-light-35-watts-4000k-3850-lumens-48-inch-adjustable-height-6-foot-cord>: HTTP status code is not handled or not allowed
2026-01-10 20:18:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stop-quick-re511-asa-3761160>: HTTP status code is not handled or not allowed
2026-01-10 20:18:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/-light-duty-non-lighted-warning-whip-white>: HTTP status code is not handled or not allowed
2026-01-10 20:18:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-wall-mounted-shelf-15-inch-24-inch-shelf>: HTTP status code is not handled or not allowed
2026-01-10 20:18:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-heavy-duty-quick-disconnect-warning-whip-w-o-light-12-x11-orange-rectangle-flag>: HTTP status code is not handled or not allowed
2026-01-10 20:18:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-heavy-duty-standard-threaded-hex-base-warning-whip-w-o-light-12-x9-yellow-triangle-flag>: HTTP status code is not handled or not allowed
2026-01-10 20:18:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-dia-round-number-paper-labels-with-2-print-black-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:18:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-silicone-sheet-24-l-x-24-w-x-1-16-thick-blue-detectable-60a>: HTTP status code is not handled or not allowed
2026-01-10 20:18:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crowd-control-stanchion-40-in-stainless-steel-post-red-belt-10-ft-l>: HTTP status code is not handled or not allowed
2026-01-10 20:18:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-x-40-4-piece-mirror-carton-1pc>: HTTP status code is not handled or not allowed
2026-01-10 20:18:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-mount-magnetic-retractable-belt-barrier-black-yellow-mount-black-yellow-15-ft-l>: HTTP status code is not handled or not allowed
2026-01-10 20:18:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-heavy-duty-quick-disconnect-warning-whip-w-o-light-16-x16-yellow-w-x-rectangle-flag>: HTTP status code is not handled or not allowed
2026-01-10 20:18:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-dia-round-number-paper-labels-with-3-print-fluorescent-red-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:18:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plug-blade-retainer-3598046>: HTTP status code is not handled or not allowed
2026-01-10 20:18:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700432clr-hshaped-pegboard-display-32w-x-60h-clr-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 20:18:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-32-x-1-2-cotter-pin-316-stainless-steel-asme-18-8-1-made-in-usa>: HTTP status code is not handled or not allowed
2026-01-10 20:18:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cross-link-protector-bridge-for-gd5x125-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:18:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/700445blu-pinwheel-pegboard-display-135w-x-44h-bl-1-pc>: HTTP status code is not handled or not allowed
2026-01-10 20:18:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rectangular-inventory-paper-labels-7l-x-5w-fluorescent-red-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:18:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/34-dia-round-inventory-paper-labels-fluorescent-pink-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:18:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/600059-cchannel-15h-clr-10-pc>: HTTP status code is not handled or not allowed
2026-01-10 20:18:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-7-dia-72-inch-h-yellow-blue-tape>: HTTP status code is not handled or not allowed
2026-01-10 20:18:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/88in-w-x44in-d-reception-station-with-non-electric-raceway-gray-counter-blue-panel>: HTTP status code is not handled or not allowed
2026-01-10 20:18:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-x-2-x-2-mailers>: HTTP status code is not handled or not allowed
2026-01-10 20:18:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-3-8-drive-6-point-15-16-deep>: HTTP status code is not handled or not allowed
2026-01-10 20:18:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/work-height-platform-truck-rnh-3048-6py-ah-with-hardboard-top-30-x-48-adj-height>: HTTP status code is not handled or not allowed
2026-01-10 20:18:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x-2-1-2-x-1-mailers>: HTTP status code is not handled or not allowed
2026-01-10 20:18:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/milwaukee-174-48-03-0200-vacuum-hose-adapter-miter-saws-6950-20-6955-20>: HTTP status code is not handled or not allowed
2026-01-10 20:18:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/louisiana-state-hitch-cover-4-1-2-x-3-3-8-14972>: HTTP status code is not handled or not allowed
2026-01-10 20:18:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arkansas-hitch-cover-4-1-2-x-3-3-8-14981>: HTTP status code is not handled or not allowed
2026-01-10 20:18:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kansas-hitch-cover-4-1-2-x-3-3-8-15094>: HTTP status code is not handled or not allowed
2026-01-10 20:18:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fs7-4e-flow-switch-1-1-4-npt>: HTTP status code is not handled or not allowed
2026-01-10 20:18:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-outdoor-in-ground-steel-flat-bench-perforated-metal-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:18:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-20-gallon-perforated-steel-receptacle-w-flat-lid-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:18:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-3-8-drive-12-point-11-16-short>: HTTP status code is not handled or not allowed
2026-01-10 20:18:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-dia-round-paper-labels-with-qc-rejected-print-fluorescent-red-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:18:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nhl-chicago-blackhawks-hitch-cover-4-1-2-x-3-3-8-14963>: HTTP status code is not handled or not allowed
2026-01-10 20:18:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ft125c-5-f-t-trap-1-1-4-in>: HTTP status code is not handled or not allowed
2026-01-10 20:19:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-8482-double-fork-forkli-hook-attachment-4000-lb-cap-swivel-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:19:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tsi-upholstered-clutter-catcher-bench-seat-console-model-30011-in-vinyl-black>: HTTP status code is not handled or not allowed
2026-01-10 20:19:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/virtua-protective-eyewear-with-foam-gasket-black-frame-gray-lens>: HTTP status code is not handled or not allowed
2026-01-10 20:19:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-non-electric-office-partition-panel-with-raceway-48-1-4w-x-101-1-2h-tan-gl>: HTTP status code is not handled or not allowed
2026-01-10 20:19:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-12-x-2-literature-mailers>: HTTP status code is not handled or not allowed
2026-01-10 20:19:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nhl-phoenix-coyotes-grill-mat-14246>: HTTP status code is not handled or not allowed
2026-01-10 20:19:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/taylor-percussion-hammer-with-256-cps-tuning-fork>: HTTP status code is not handled or not allowed
2026-01-10 20:19:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moo-tel-calf-nursery-w-doors-18w-x-28l-white>: HTTP status code is not handled or not allowed
2026-01-10 20:19:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nba-miami-heat-grill-mat-14210>: HTTP status code is not handled or not allowed
2026-01-10 20:19:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-sheet-12-l-x-12-w-x-3-4-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:19:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nhl-minnesota-wild-grill-mat-14238>: HTTP status code is not handled or not allowed
2026-01-10 20:19:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/taylor-percussion-hammer-latex-free-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:19:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-partition-panel-with-partial-window-and-pass-thru-cable-60-1-4w-x-100h-blue-gl>: HTTP status code is not handled or not allowed
2026-01-10 20:19:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-bar-48-l-x-2-1-2-w-x-1-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:19:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/000-4x8-self-seal-white-bubble-mailers>: HTTP status code is not handled or not allowed
2026-01-10 20:19:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stud-remover-6mm-1-2-drive>: HTTP status code is not handled or not allowed
2026-01-10 20:19:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moo-tel-calf-nursery-w-open-ends-18w-x-20l-white>: HTTP status code is not handled or not allowed
2026-01-10 20:19:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18867 pages (at 97 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:19:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-epdm-roll-120-l-x-12-w-x-3-4-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:19:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-10-1-2x16-self-seal-white-bubble-mailers>: HTTP status code is not handled or not allowed
2026-01-10 20:19:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ax12842-biometric-keypad-security-safe-1412w-x-16d-x-1712h-194-cubic-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:19:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mfsd506va-first-aid-kit-sign-10w-x-7h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:19:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-20w-zippered-end-panel-green>: HTTP status code is not handled or not allowed
2026-01-10 20:19:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neodymium-magnetic-hook-40-lbs-pull-nickel-chrome-plating>: HTTP status code is not handled or not allowed
2026-01-10 20:19:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-3-8-drive-6-point-9-16-deep>: HTTP status code is not handled or not allowed
2026-01-10 20:19:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/17-x-21-self-seal-white-stayflat-mailers>: HTTP status code is not handled or not allowed
2026-01-10 20:19:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rectangle-mailing-labels-2l-x-1w-clear-roll-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:19:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/direct-thermal-labels-4w-x-4l-3-core-white-4pack>: HTTP status code is not handled or not allowed
2026-01-10 20:19:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-7-1-4x12-self-seal-kra-padded-mailers>: HTTP status code is not handled or not allowed
2026-01-10 20:19:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-3-4-x-10-3-4-x-2-1-4-deluxe-literature-mailers>: HTTP status code is not handled or not allowed
2026-01-10 20:19:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-outdoor-in-ground-steel-flat-bench-expanded-metal-green>: HTTP status code is not handled or not allowed
2026-01-10 20:19:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-sheet-48-l-x-48-w-x-1-8-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:19:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kdd738-steering-wheel-message-cover-vinyl-24-diameter>: HTTP status code is not handled or not allowed
2026-01-10 20:19:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-door-ovation-letter-board-burgundy-w-gray-frame-24-1-8w-x-33-3-4h>: HTTP status code is not handled or not allowed
2026-01-10 20:19:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-door-enclosed-flannel-letter-board-w-oak-frame-30w-x-36h-burgundy>: HTTP status code is not handled or not allowed
2026-01-10 20:19:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-wide-rafter-kit-for-econoline-buildings>: HTTP status code is not handled or not allowed
2026-01-10 20:19:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-of-print-3l-x-2w-fluorescent-yellow-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:19:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harvey-black-computer-desk-with-silver-metal-framenan-jn-21721-gg>: HTTP status code is not handled or not allowed
2026-01-10 20:19:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labels-with-cod-print-3l-x-2w-fluorescent-red-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:19:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x24-2-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-socket-1-2-drive-flex-14mm-6-point-flex-short>: HTTP status code is not handled or not allowed
2026-01-10 20:19:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-door-enclosed-vinyl-tackboard-navy-w-silver-frame-72w-x-48h>: HTTP status code is not handled or not allowed
2026-01-10 20:19:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-foam-epdm-roll-120-l-x-54-w-x-1-2-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:19:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-door-enclosed-fabric-tackboard-gray-fabric-silver-frame-96w-x-48h>: HTTP status code is not handled or not allowed
2026-01-10 20:19:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-uhmw-polyethylene-bar-24-l-x-1-2-w-x-1-4-thick-black-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:19:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/htg-trolley-1-2-ton-geared-wide-flange-width>: HTTP status code is not handled or not allowed
2026-01-10 20:19:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-x-12-open-end-static-shielding-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-point-combination-wrench-3-4>: HTTP status code is not handled or not allowed
2026-01-10 20:19:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/madm139vs-danger-sign-do-not-enter-14w-x-10h-adhesive-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 20:19:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hamilton-aluminum-hand-truck-10-ace-tuf-wheels>: HTTP status code is not handled or not allowed
2026-01-10 20:19:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-composite-carbon-fiber-bar-12-l-x-3-w-x-1-8-thick-black-bulk-cs-cf-43>: HTTP status code is not handled or not allowed
2026-01-10 20:19:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s153-zebra-thermal-transfer-ribbons-3-18w-x-1476l-wax-black-24-rollscase>: HTTP status code is not handled or not allowed
2026-01-10 20:19:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scrubbing-pads-for-p-4000-multi-purpose-dual-headed-floor-machine-6>: HTTP status code is not handled or not allowed
2026-01-10 20:19:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mchl174vs-danger-sign-acetylene-14w-x-10h-adhesive-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 20:19:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kdd477-trailer-lock-glad-hand-lockout-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:19:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-x4-x24-2-mil-gusseted-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-x8-x24-2-mil-gusseted-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rectangular-inventory-paper-labels-4l-x-4w-black-roll-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:19:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/poly-z-brite-post-86in-h-leveler-installed-pack-of-four>: HTTP status code is not handled or not allowed
2026-01-10 20:19:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcsp133va-danger-sign-confined-space-enter-by-permit-only-10w-x-7h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:19:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-p-general-clamp-assembly-for-tube-pipe-hydraulic-hose>: HTTP status code is not handled or not allowed
2026-01-10 20:19:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24x36-2-mil-anti-static-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/msmk243vp-danger-sign-flammable-material-no-smoking-or-open-flames-14w-x-10h-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:19:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pm1900tx-base-machine-dust-collector-1100-cfm-3hp-3ph-460v>: HTTP status code is not handled or not allowed
2026-01-10 20:19:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcsp140va-danger-sign-confined-space-authorized-personnel-only-10w-x-7h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:19:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-sheet-6-l-x-6-w-x-1-8-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:19:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-sheet-48-l-x-48-w-x-3-8-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:19:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-enclosed-wire-stockpicker-truck-dolly-base-60-x-24-x-69-1000-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:19:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-socket-3-4-drive-1-11-16-6-point-short>: HTTP status code is not handled or not allowed
2026-01-10 20:19:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f6-woven-split-wrappable-sleeve-1-dia-100-black>: HTTP status code is not handled or not allowed
2026-01-10 20:19:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-strapping-3-4-inches-w-x-0-point-030-inches-x-100-feet>: HTTP status code is not handled or not allowed
2026-01-10 20:19:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-socket-3-8-drive-14mm-6-point-deep>: HTTP status code is not handled or not allowed
2026-01-10 20:19:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-bar-24-l-x-1-1-2-w-x-1-8-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:19:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15x36-4-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16x18-4-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-tube-od-zinc-plated-anti-vibration-cush-a-clamp>: HTTP status code is not handled or not allowed
2026-01-10 20:19:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/weld-on-forged-3-4-d-ring-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:19:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-bar-12-l-x-4-w-x-1-2-thick-clear-scratch-and-uv-resistant>: HTTP status code is not handled or not allowed
2026-01-10 20:19:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcsp130vs-danger-sign-confined-space-enter-by-permit-only-10w-x-7h-adhesive-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 20:19:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-8-tube-od-zinc-plated-omega-cushion-clamp>: HTTP status code is not handled or not allowed
2026-01-10 20:19:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7447-pro-hand-pad-6-x-9-in-20-padsbox-3-boxescase>: HTTP status code is not handled or not allowed
2026-01-10 20:19:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-ibc-spill-pallet-plus-with-no-drain>: HTTP status code is not handled or not allowed
2026-01-10 20:19:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polyester-film-600-l-x-36-w-x-0-0005-thick-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:19:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-sheet-12-l-x-12-w-x-3-32-thick-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:19:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x8-x24-1-5-mil-gusseted-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lx3-powderfree-textured-industrial-grade-latex-gloves-small-100box-10-boxcs>: HTTP status code is not handled or not allowed
2026-01-10 20:19:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-x18-x30-1-5-mil-gusseted-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcsp130vp-danger-sign-confined-space-enter-by-permit-only-10w-x-7h-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:19:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x2-x12-2-mil-gusseted-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mdt185ctp-danger-tag-pf-cardstock-25pack>: HTTP status code is not handled or not allowed
2026-01-10 20:19:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gpx3-powderfree-industrial-grade-vinyl-gloves-small-100box-10-boxcs>: HTTP status code is not handled or not allowed
2026-01-10 20:19:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tab105ptp-caution-barricade-tag-rp-plastic-25pack>: HTTP status code is not handled or not allowed
2026-01-10 20:19:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-socket-1-4-drive-10mm-deep>: HTTP status code is not handled or not allowed
2026-01-10 20:19:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-1-4x3x13-1-5-mil-gusseted-polypropylene-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:19:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21-fabric-heat-shrink-197-diameter-dia-25-black>: HTTP status code is not handled or not allowed
2026-01-10 20:19:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-pvc-type-2-sheet-24-l-x-12-w-x-1-2-thick-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:19:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/male-single-swivel-socket-member-2>: HTTP status code is not handled or not allowed
2026-01-10 20:19:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duraflex-woven-high-abrasion-sleeve-83-dia-100-black>: HTTP status code is not handled or not allowed
2026-01-10 20:19:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z-line-additional-perforated-steel-shelf-level-with-clips-48-w-x-12-d-x-1-5-16-h>: HTTP status code is not handled or not allowed
2026-01-10 20:19:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z-line-boltless-shelving-w-steel-industrial-shelves-42-w-x-24-d-x-84-h-add-on-5-shelves>: HTTP status code is not handled or not allowed
2026-01-10 20:19:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3x12-1-5-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:20:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speco-2mp-hd-tvi-ptz-speed-dome-camera-47-94mm-20x-optical-zoom-lens-white-housing>: HTTP status code is not handled or not allowed
2026-01-10 20:20:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cortech-usa-86484sb-5-chair-razorback-slate-blue-5-pack-5-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:20:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4x12-1-5-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:20:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-rectangular-tube-24-l-x-3-4-w-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:20:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mop-bucket-wringer-combo-26-qt-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:20:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/firex-smoke-alarm-hardwired-with-10-years-backup-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:20:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g18-175-ff-25hp-oil-injected-rotary-screw-floor-mount-175psi-3ph-208-230-460v>: HTTP status code is not handled or not allowed
2026-01-10 20:20:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-12-open-end-static-shielding-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:20:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-nylon-6-6-bar-12-l-x-6-w-x-3-8-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:20:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-bar-24-l-x-2-w-x-1-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:20:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g18-175-ap-25hp-oil-injected-rotary-screw-132-gal-tank-mnt-175psi-3ph-208-230-460v>: HTTP status code is not handled or not allowed
2026-01-10 20:20:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machined-type-needle-roller-bearing-metric-taf81516-8mm-bore-15mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:20:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-led-radar-feedback-trailer-sign-solar-powered-55w-x-106d-x-97h-blackwhite>: HTTP status code is not handled or not allowed
2026-01-10 20:20:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durapan-dustpan-combo-black>: HTTP status code is not handled or not allowed
2026-01-10 20:20:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/insultherm-resin-coated-fiberglass-sleeve-75-dia-200-black>: HTTP status code is not handled or not allowed
2026-01-10 20:20:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1flexo-pet-general-purpose-sleeving-dia-65-red>: HTTP status code is not handled or not allowed
2026-01-10 20:20:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermashield-aluminized-fiberglass-tube-75-dia-100-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:20:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 18967 pages (at 100 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:20:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/efp-b-passive-welding-helmet-10-fixed-shade-clear-lens-captain-america-graphic>: HTTP status code is not handled or not allowed
2026-01-10 20:20:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-platform-janitorial-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:20:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mcpg101vp-danger-sign-compressed-gas-10w-x-7h-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:20:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coxreels-sh-n-350-hv-3-8in-x-50ft-300psi-heavy-duty-spring-retractable-low-pressure-safety-hose-reel>: HTTP status code is not handled or not allowed
2026-01-10 20:20:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2flexo-pet-general-purpose-sleeving-dia-50-white>: HTTP status code is not handled or not allowed
2026-01-10 20:20:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machined-type-needle-roller-bearing-metric-separable-cage-5mm-bore-10mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:20:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/af315-disinfectant-cleaner-citrus-floral-scent-2-l-bottle-4case>: HTTP status code is not handled or not allowed
2026-01-10 20:20:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/efp-e-auto-darkening-welding-helmet-9-13-variable-shade-d-day-graphic>: HTTP status code is not handled or not allowed
2026-01-10 20:20:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fvp-economy-round-container-dolly-black>: HTTP status code is not handled or not allowed
2026-01-10 20:20:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-handrail-socket-1>: HTTP status code is not handled or not allowed
2026-01-10 20:20:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/handrail-bracket>: HTTP status code is not handled or not allowed
2026-01-10 20:20:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/meqc721va-caution-sign-do-not-operate-without-guards-14w-x-10h-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:20:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sparta-hand-nail-brush-with-polyester-bristles-5-x-2>: HTTP status code is not handled or not allowed
2026-01-10 20:20:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flo-pac-professional-automatic-sponge-mop-12-x-51>: HTTP status code is not handled or not allowed
2026-01-10 20:20:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3flexo-pet-general-purpose-sleeving-dia-200-green>: HTTP status code is not handled or not allowed
2026-01-10 20:20:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hurricane-360-hoist-and-trolley-combo-geared-20-ton-capacity-20-lift>: HTTP status code is not handled or not allowed
2026-01-10 20:20:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-airpot-racks-univ-6-apr-357280005>: HTTP status code is not handled or not allowed
2026-01-10 20:20:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/49-1-4-x-41-1-4-x-4-heavy-duty-gaylord-lids-423015>: HTTP status code is not handled or not allowed
2026-01-10 20:20:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/meqm617vp-caution-sign-low-overhead-clearance-10w-x-7h-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:20:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fastdraw-19-green-earth-glass-cleaner-pleasant-scent-2-l-bottle-4case>: HTTP status code is not handled or not allowed
2026-01-10 20:20:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/refrigerated-truck-edge-of-dock-leveler-72-usable-w-94-overall-w-30-000-lb-986650>: HTTP status code is not handled or not allowed
2026-01-10 20:20:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x-30-open-end-static-shielding-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:20:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/refrigerated-truck-edge-of-dock-leveler-78-usable-w-100-overall-w-20-000-lb-986645>: HTTP status code is not handled or not allowed
2026-01-10 20:20:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-sheet-12-l-x-12-w-x-3-8-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:20:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hurricane-360-hoist-and-trolley-combo-standard-2-ton-capacity-30-lift>: HTTP status code is not handled or not allowed
2026-01-10 20:20:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-sheet-12-l-x-12-w-x-3-16-thick-clear-scratch-and-uv-resistant>: HTTP status code is not handled or not allowed
2026-01-10 20:20:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acudor-18x18-plastic-access-door>: HTTP status code is not handled or not allowed
2026-01-10 20:20:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-oz-bottles-wide-mouth-round-clear-33-400-ptfe-lined-caps-case-of-48>: HTTP status code is not handled or not allowed
2026-01-10 20:20:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jct-3620-3-4-bolt-air-chipping-hammer-round-shank-2-200-bpm-90-psi-34-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:20:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omnimed-stainless-twin-narcotic-cabinet-double-door-4-adjustable-shelves-22w-x-8d-x-15h>: HTTP status code is not handled or not allowed
2026-01-10 20:20:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-bracket-extension-assembly>: HTTP status code is not handled or not allowed
2026-01-10 20:20:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lip-and-tape-seal-bubble-pouch-10-x-1512-x-316-with-112-lip-seal-clear-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:20:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12v-jump-starter-2000-peak-amps-jnc950>: HTTP status code is not handled or not allowed
2026-01-10 20:20:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permit-control-station-with-group-lock-box-wall-mounted-red-s3500>: HTTP status code is not handled or not allowed
2026-01-10 20:20:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-bar-36-l-x-4-w-x-1-8-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:20:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caw-stationary-electric-pressure-washer-2000-psi-6-hp-39-gpm-1-phase-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:20:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8mm-e-z-crimper-standard-seal>: HTTP status code is not handled or not allowed
2026-01-10 20:20:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x20-3-mil-flat-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:20:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-bar-24-l-x-1-w-x-1-4-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:20:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-bar-24-l-x-2-w-x-1-2-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:20:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-bar-48-l-x-4-w-x-3-8-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:20:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/psfo13-pipeline-16-add-on-arm>: HTTP status code is not handled or not allowed
2026-01-10 20:20:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jlp-a-series-lever-hoist-w-shipyard-hooks-1-1-2-ton-5-ft-lift>: HTTP status code is not handled or not allowed
2026-01-10 20:20:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1838-series-5pc-hss-multi-purpose-carbide-tipped-masonry-drill-set-1-8-5-32-3-16-1-4-5-16>: HTTP status code is not handled or not allowed
2026-01-10 20:20:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/x-connect-xl-eyelet-terminal-connector-16-awg-21l-cable>: HTTP status code is not handled or not allowed
2026-01-10 20:20:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-emergency-light-dual-head-self-diagnostic-remote-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:20:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35211-twist-lock-locking-liquid-dispenser-white-pump-top-round-bottle-4-oz>: HTTP status code is not handled or not allowed
2026-01-10 20:20:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frontline-in-counter-condiment-p4100>: HTTP status code is not handled or not allowed
2026-01-10 20:20:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speakman-se-697-traditional-series-combination-emergency-station>: HTTP status code is not handled or not allowed
2026-01-10 20:20:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oasis-pwebq-quasar153-electronic-retrofit-bottle-filler-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:20:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5a-battery-charger-5-bank-on-board-battery-charger-waterproof-at-ip68-genius5>: HTTP status code is not handled or not allowed
2026-01-10 20:20:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freestanding-2-panel-corner-room-divider-24-x-42-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:20:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-handle-w-stud-m10-x-1-5-x-63mm-stud-78mm-l-x-54mm-h-die-cast-handle-mh-423>: HTTP status code is not handled or not allowed
2026-01-10 20:20:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freestanding-2-panel-corner-room-divider-24-x-72-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:20:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-2-panel-corner-room-divider-24-x-42-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:20:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-dome-replacement-accessories-bd104>: HTTP status code is not handled or not allowed
2026-01-10 20:20:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardair-gunslinger-air-gun-holder>: HTTP status code is not handled or not allowed
2026-01-10 20:20:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-polycarbonate-sheet-48-l-x-48-w-x-1-2-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:20:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/entrance-mat-3-8-thick-3-x-10-gray-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:20:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alternating-stair-10-68-degree-angle>: HTTP status code is not handled or not allowed
2026-01-10 20:20:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-service-condiment-centers-p9724>: HTTP status code is not handled or not allowed
2026-01-10 20:20:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelf-36w-x-12-d>: HTTP status code is not handled or not allowed
2026-01-10 20:20:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardair-compact-thumbswitch-safety-air-gun>: HTTP status code is not handled or not allowed
2026-01-10 20:20:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freestanding-3-panel-corner-room-divider-24-x-72-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:20:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portion-cup-box-system-c9002>: HTTP status code is not handled or not allowed
2026-01-10 20:20:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cpvc-bar-12-l-x-4-w-x-1-thick-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:20:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/em-19150s-eifs-mesh-self-adhesive-16-x-150>: HTTP status code is not handled or not allowed
2026-01-10 20:20:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40626-2x-3x-fishing-vest-mesh-tan-2x-large-3x-large>: HTTP status code is not handled or not allowed
2026-01-10 20:20:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0990-1040-kg-l-draft-survey-hydrometer>: HTTP status code is not handled or not allowed
2026-01-10 20:20:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardair-mini-vacuum-attachment-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:20:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardair-ultra-xtra-thrust-48-alum-ext-alloy-nozzle-long-trigger>: HTTP status code is not handled or not allowed
2026-01-10 20:20:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sn-20016-fire-resistant-safety-netting-86-ft-x-150-ft-black-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:20:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-organizer-with-22-removable-bins>: HTTP status code is not handled or not allowed
2026-01-10 20:20:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chrome-wire-mobile-desk-29-12x18x42>: HTTP status code is not handled or not allowed
2026-01-10 20:20:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelate-wire-shelving-36605ep-60w-x-36d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:20:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-rod-36-l-x-2-1-2-dia-black>: HTTP status code is not handled or not allowed
2026-01-10 20:20:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x-42-white-mailing-tubes-with-caps-case>: HTTP status code is not handled or not allowed
2026-01-10 20:20:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-hdpe-sheet-24-l-x-12-w-x-1-2-thick-black-marine>: HTTP status code is not handled or not allowed
2026-01-10 20:20:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-725-multifunction-process-calibrator-measure-source-ma-volts-temp-freq>: HTTP status code is not handled or not allowed
2026-01-10 20:20:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roll-out-extra-shelving-starter-4-shelf-36x36x85>: HTTP status code is not handled or not allowed
2026-01-10 20:20:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/0700-0810-specific-gravity-hydrometer-for-liquids-lighter-than-water>: HTTP status code is not handled or not allowed
2026-01-10 20:21:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelate-wire-shelving-add-on-a36726ep-72w-x-36d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:21:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-100-percent-isopropyl-alcohol-hydrometer>: HTTP status code is not handled or not allowed
2026-01-10 20:21:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freestanding-3-panel-corner-room-divider-with-partial-window-60-x-60-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:21:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardair-ultra-whisper-jet-6-alum-ext-alum-nozzle-short-trigger>: HTTP status code is not handled or not allowed
2026-01-10 20:21:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pilaster-with-shoe-6in-w-x-82in-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:21:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-1577-insulation-multimeter-0-1-m-ohm-to-600-m-ohm>: HTTP status code is not handled or not allowed
2026-01-10 20:21:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-container-38-1-5-x-18-x-9-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:21:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-3-4-x-2-3-8-5-wired-rejected>: HTTP status code is not handled or not allowed
2026-01-10 20:21:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indoor-corral-2-end-2-corner-posts-2-5-4-6-rails-16-anchors-986658>: HTTP status code is not handled or not allowed
2026-01-10 20:21:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-hydraulic-jack-25-10-ton-25-2>: HTTP status code is not handled or not allowed
2026-01-10 20:21:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tire-mounting-compound-honey-color-25-lbs-79210>: HTTP status code is not handled or not allowed
2026-01-10 20:21:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-dust-collector-cartridge-open-closed-with-bolt-hole-paper-base>: HTTP status code is not handled or not allowed
2026-01-10 20:21:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fluke-i1010-acdc-current-clamp-dc-current-from-1-1000a-ac-current-from-1-600a>: HTTP status code is not handled or not allowed
2026-01-10 20:21:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-hdpe-bar-12-l-x-1-1-2-w-x-1-4-thick-white-marine>: HTTP status code is not handled or not allowed
2026-01-10 20:21:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-rod-36-l-x-2-3-4-dia-black>: HTTP status code is not handled or not allowed
2026-01-10 20:21:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shureshop-bench-w-acc-kit-portable-stainless-steel-top-72-x-29-monaco-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:21:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-hdpe-bar-12-l-x-1-w-x-1-2-thick-white-marine>: HTTP status code is not handled or not allowed
2026-01-10 20:21:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19065 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:21:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/autoclavable-polypropylene-carboy-with-spigot-10-liters-26-gallons>: HTTP status code is not handled or not allowed
2026-01-10 20:21:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clay-desiccant-bags-5-34w-x-10l-x-1-12d-white-150-packs>: HTTP status code is not handled or not allowed
2026-01-10 20:21:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-wall-container-solid-sides-base-15-3-4-x11-3-4-x8-1-4-red-662123rd>: HTTP status code is not handled or not allowed
2026-01-10 20:21:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drain-transmission-3610>: HTTP status code is not handled or not allowed
2026-01-10 20:21:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cloud-foam-roll-12w-x-18l-x-2-thick-white-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:21:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-oz-stand-up-zip-pouches-4-mil-clear-1000-case-stp-4z-400a>: HTTP status code is not handled or not allowed
2026-01-10 20:21:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/do-not-stack-pallet-cones-english-pkg-qty-50>: HTTP status code is not handled or not allowed
2026-01-10 20:21:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-275-containment-sump-360-gallon-capacity-with-no-drain>: HTTP status code is not handled or not allowed
2026-01-10 20:21:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silhouette-banquet-stacking-chair-fabric-blue-9350-series>: HTTP status code is not handled or not allowed
2026-01-10 20:21:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-pop-up-pool-250-gallon-capacity-economy-style>: HTTP status code is not handled or not allowed
2026-01-10 20:21:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-2w-6l-1-ply-eye-eye-poly-web-sling-flat-eyes>: HTTP status code is not handled or not allowed
2026-01-10 20:21:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crinkle-paper-10-lbs-white>: HTTP status code is not handled or not allowed
2026-01-10 20:21:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orbis-stakpak-modular-straight-wall-container-16l-x-15w-x-9-12h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:21:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calibrated-elec-stainless-steel-stem-thermometer-50-200c-120mm-47-blunt-tip-probe>: HTTP status code is not handled or not allowed
2026-01-10 20:21:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-cs120-2e-20-amp-120-277-volt-toggle-single-pole-ac-quiet-switch-black>: HTTP status code is not handled or not allowed
2026-01-10 20:21:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-2-liter-polypropylene-spout-pouring-pitcher>: HTTP status code is not handled or not allowed
2026-01-10 20:21:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-2w-6l-2-ply-endless-poly-flat-web-sling>: HTTP status code is not handled or not allowed
2026-01-10 20:21:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roundup-2w-16l-endless-poly-roundsling-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:21:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orbis-stakpak-modular-straight-wall-container-12l-x-15w-x-7-12h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:21:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-add-on-21728gz-72w-x-21d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:21:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-in-h-lift-out-guard-rail-in-line-post-single-rail>: HTTP status code is not handled or not allowed
2026-01-10 20:21:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galileo-thermometer-18-to-26c-64-to-80f-5-spheres-11>: HTTP status code is not handled or not allowed
2026-01-10 20:21:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galileo-thermometer-18-to-26c-64-to-80f-5-spheres-13>: HTTP status code is not handled or not allowed
2026-01-10 20:21:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bench-rack-12x36x21-with-19-gray-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:21:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/euro-drawer-5-9-16w-x-23-7-8d-x-4-5-8h-red>: HTTP status code is not handled or not allowed
2026-01-10 20:21:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlocking-storage-cabinet-11-3-4w-11-3-8d-x-11h-10-red-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:21:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-1w-8l-1-ply-endless-poly-flat-web-sling>: HTTP status code is not handled or not allowed
2026-01-10 20:21:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/70h-single-sided-floor-stand-with-96-drawer-interlocking-storage-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 20:21:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-epoxy-wire-shelving-21306gz-30w-x-21d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:21:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-3w-20l-1-ply-eye-eye-poly-web-sling-flat-eyes>: HTTP status code is not handled or not allowed
2026-01-10 20:21:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/taski-paper-vacuum-bag-baby-bora>: HTTP status code is not handled or not allowed
2026-01-10 20:21:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-hdpe-sheet-48-l-x-12-w-x-1-thick-white-marine>: HTTP status code is not handled or not allowed
2026-01-10 20:21:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-hdpe-sheet-48-l-x-12-w-x-1-2-thick-white-marine>: HTTP status code is not handled or not allowed
2026-01-10 20:21:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-1w-8l-1-ply-eye-eye-poly-web-sling-twisted-eyes>: HTTP status code is not handled or not allowed
2026-01-10 20:21:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-plastic-cabinet-drawer-5-5-8w-x-11d-x-2-1-2h>: HTTP status code is not handled or not allowed
2026-01-10 20:21:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-2w-6l-2-ply-eye-eye-poly-web-sling-twisted-eyes>: HTTP status code is not handled or not allowed
2026-01-10 20:21:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/euro-drawer-8-3-8w-x-17-5-8d-x-4-5-8h-red>: HTTP status code is not handled or not allowed
2026-01-10 20:21:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/four-wheel-drum-cart-for-120-lbs-16-gallon-drums>: HTTP status code is not handled or not allowed
2026-01-10 20:21:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/55-gallon-cover>: HTTP status code is not handled or not allowed
2026-01-10 20:21:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kendall-howard-advanced-classroom-training-table-24-x-48-folkstone>: HTTP status code is not handled or not allowed
2026-01-10 20:21:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-3-4-x-1-3-8-1-manila-shipping-tag-1>: HTTP status code is not handled or not allowed
2026-01-10 20:21:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-edge-3w-4l-2-ply-eye-eye-poly-web-sling-twisted-eyes>: HTTP status code is not handled or not allowed
2026-01-10 20:21:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kendall-howard-advanced-classroom-training-table-24-x-60-african-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 20:21:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h-b-durac-maximum-registering-autoclave-bi-metal-thermometer-20-to-150c-0-to-300f>: HTTP status code is not handled or not allowed
2026-01-10 20:21:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kendall-howard-advanced-classroom-training-table-30-x-72-african-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 20:21:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kendall-howard-advanced-classroom-training-table-48-cable-management-enclosure>: HTTP status code is not handled or not allowed
2026-01-10 20:21:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-1-2-x-3-3-4-11-manila-pre-strung-tag>: HTTP status code is not handled or not allowed
2026-01-10 20:21:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlocking-storage-cabinet-11-3-4w-11-3-8d-x-11h-6-blue-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:21:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-plastic-bin-16-1-4l-x-11-3-4w-x-22h-light-pink>: HTTP status code is not handled or not allowed
2026-01-10 20:21:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-tube-12-l-x-1-id-x-1-3-4-od-white>: HTTP status code is not handled or not allowed
2026-01-10 20:21:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-rack-24x36x60-with-144-gray-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:21:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-rack-24x36x60-with-144-red-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:21:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tall-standard-wood-luggage-rack-espresso-finish>: HTTP status code is not handled or not allowed
2026-01-10 20:21:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h-b-enviro-safe-general-purpose-liquid-in-glass-thermometer-30-to-120f-total-immersion>: HTTP status code is not handled or not allowed
2026-01-10 20:21:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlocking-storage-cabinet-11-3-4w-11-3-8d-x-11h-12-ivory-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:21:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-rod-12-l-x-2-1-4-dia-black>: HTTP status code is not handled or not allowed
2026-01-10 20:21:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grease-pump-hand-operated>: HTTP status code is not handled or not allowed
2026-01-10 20:21:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-piece-outdoor-dining-set-w-chairs-and-benches-gray-with-white-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:21:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-astm-like-liquid-in-glass-thermometer-113c-softening-point-bitumen-wide-range>: HTTP status code is not handled or not allowed
2026-01-10 20:21:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tv-cctv-monitor-wall-mount-bracket-for-monitor-14in-21in>: HTTP status code is not handled or not allowed
2026-01-10 20:21:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tempco-hd-cartridge-38od-4l-120v-300w-74>: HTTP status code is not handled or not allowed
2026-01-10 20:21:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-container-with-lid-61-1-4-x-5-1-4-x-7-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:21:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buyers-steel-underbody-box-w-ss-door-black-18x18x36>: HTTP status code is not handled or not allowed
2026-01-10 20:21:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simplehuman-174-butterfly-step-can-8-gallon-brushed-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:21:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/55-x-35-rectangle-outdoor-table-mocha-polymer-top-silver-aluminum-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:21:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tempco-channel-strip-120v-t3-10-12l-250w>: HTTP status code is not handled or not allowed
2026-01-10 20:21:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tempco-finned-strip-240v-t4-23-34l-2200w>: HTTP status code is not handled or not allowed
2026-01-10 20:21:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-rod-48-l-x-2-3-4-dia-black>: HTTP status code is not handled or not allowed
2026-01-10 20:21:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sw8gr-op-self-aligning-open-linear-bearing-wresin-retainer-12id-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:21:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-round-table-chair-set-studio-teak-table-top-with-navy-chairs>: HTTP status code is not handled or not allowed
2026-01-10 20:21:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-1-2-x-5-1-2-yellow-packing-list-enclosed-panel-face>: HTTP status code is not handled or not allowed
2026-01-10 20:21:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leather-guest-sofa-black-hercules-diplomat-series>: HTTP status code is not handled or not allowed
2026-01-10 20:21:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-density-stacking-chair-with-sled-base-fabric-black-hercules-series>: HTTP status code is not handled or not allowed
2026-01-10 20:21:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contemporary-modular-lounge-chair-leather-melrose-white-hercules-regal-series>: HTTP status code is not handled or not allowed
2026-01-10 20:21:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-square-bistro-table-4-barstool-set-espresso-table-top-with-navy-stools>: HTTP status code is not handled or not allowed
2026-01-10 20:21:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buyers-aluminum-topside-w-t-handle-18x16x90>: HTTP status code is not handled or not allowed
2026-01-10 20:21:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/218000232-blinkersign-flashing-led-pedestrian-crossing-sign-w112-36w-solar>: HTTP status code is not handled or not allowed
2026-01-10 20:21:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paint-marker-oil-based-fine-green-ink>: HTTP status code is not handled or not allowed
2026-01-10 20:21:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paint-marker-oil-based-medium-blue-ink>: HTTP status code is not handled or not allowed
2026-01-10 20:21:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/267300032-7-long-fiberglass-pedestal-utility-marker>: HTTP status code is not handled or not allowed
2026-01-10 20:21:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buyers-aluminum-underbody-box-w-t-handle-18x18x24>: HTTP status code is not handled or not allowed
2026-01-10 20:21:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buyers-steel-trailer-tongue-truck-box-48-inch-w>: HTTP status code is not handled or not allowed
2026-01-10 20:21:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-bar-12-l-x-1-1-2-w-x-3-8-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:22:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-x-4-4-mil-reclosable-poly-bags-w-hang-hole>: HTTP status code is not handled or not allowed
2026-01-10 20:22:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spruce-general-use-spray-paint-16-oz-gloss-white-12-cans-case-98-2>: HTTP status code is not handled or not allowed
2026-01-10 20:22:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reception-lounge-chair-leather-black-hercules-roman-series>: HTTP status code is not handled or not allowed
2026-01-10 20:22:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2x2-2-mil-white-block-reclosable-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:22:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-tube-36-l-x-1-5-8-id-x-1-15-16-od-white>: HTTP status code is not handled or not allowed
2026-01-10 20:22:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/individually-calibrated-1-11-degree-api-astm-1h-hydrometer>: HTTP status code is not handled or not allowed
2026-01-10 20:22:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-bar-24-l-x-1-4-w-x-1-4-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:22:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-bar-24-l-x-2-w-x-1-4-thick-off-white-glass-filled>: HTTP status code is not handled or not allowed
2026-01-10 20:22:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-x-3-4-mil-double-track-zip-poly-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:22:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buyers-stainless-steel-underbody-box-w-t-handle-white-24x24x30>: HTTP status code is not handled or not allowed
2026-01-10 20:22:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-astm-like-liquid-in-glass-thermometer-18c-reid-vapor-pressure-34-to-42c>: HTTP status code is not handled or not allowed
2026-01-10 20:22:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/estate-10w-x-6h-king-cedar-alum-composite-adj-fence-double-gate-kit-in-ground-only-ef-et2216>: HTTP status code is not handled or not allowed
2026-01-10 20:22:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-clear-label-holder>: HTTP status code is not handled or not allowed
2026-01-10 20:22:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/estate-10w-x-6h-oxford-grey-alum-composite-adj-fence-double-gate-kit-inground-only-ef-et2206>: HTTP status code is not handled or not allowed
2026-01-10 20:22:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipette-basket-4-x-32-for-cleanware-pipette-rinsing-system>: HTTP status code is not handled or not allowed
2026-01-10 20:22:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19163 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:22:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lattice-top-6w-x-6h-oxford-grey-aluminum-composite-horizontal-fence-starter-sec-inground-ef-ug2206>: HTTP status code is not handled or not allowed
2026-01-10 20:22:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lattice-top-6w-x-6h-oxford-grey-alum-composite-horizontal-fence-starter-section-in-ground-ef-lg1206>: HTTP status code is not handled or not allowed
2026-01-10 20:22:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lab-wall-freestanding-cabinet-35w-x-18d-x-84-1-4h-2-steel-doors-5-adj-shelves-model-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:22:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/estate-6w-x-6h-black-rose-aluminum-composite-horizontal-fence-adder-section-in-ground-ef-eg1226>: HTTP status code is not handled or not allowed
2026-01-10 20:22:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n51h15lnb50n-jafline-double-jacket-fire-hose-1-12-x-50-ft-400-psi-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:22:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-refrigerator-verification-thermometer-20-to-60f>: HTTP status code is not handled or not allowed
2026-01-10 20:22:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-wall-mount-wire-shelving-72w-x-18d-x-63h-4-shelf-add-on-poly-green>: HTTP status code is not handled or not allowed
2026-01-10 20:22:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/itm-30-piece-insert-set>: HTTP status code is not handled or not allowed
2026-01-10 20:22:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-wire-shelf-stem-caster-truck-black-ep-18-w-x-60-l-x-69-h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-36-l-x-4-w-x-2-1-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 20:22:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4x6-reclosable-static-shielding-bags>: HTTP status code is not handled or not allowed
2026-01-10 20:22:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyethylene-150ml-single-piece-buchner-funnel>: HTTP status code is not handled or not allowed
2026-01-10 20:22:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/en5631-technopolymer-thandle-wthreaded-stud-mm-diameter-55mm-length-51618>: HTTP status code is not handled or not allowed
2026-01-10 20:22:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-wire-shelves-utility-cart-pneumatic-wheel-casters-chrome-21-w-x-42-l-x-42-h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/itm-1-38-17-sds-max>: HTTP status code is not handled or not allowed
2026-01-10 20:22:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solid-door-back-bar-refrigerator-23-base-bb-48w-bb48y>: HTTP status code is not handled or not allowed
2026-01-10 20:22:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-wire-shelf-stem-caster-truck-poly-green-24-w-x-60-l-x-69-h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gn5983-phenolic-retractable-handle-wlocking-mechanism-23mm-dia-87mm-length-m6x10>: HTTP status code is not handled or not allowed
2026-01-10 20:22:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/en5631-technopolymer-thandle-wthreaded-stud-mm-diameter-80mm-length-m10x15>: HTTP status code is not handled or not allowed
2026-01-10 20:22:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-36-l-x-6-w-x-3-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 20:22:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-pocket-liquid-in-glass-thermometer-10-to-110c-0-to-220f-window-plastic-case>: HTTP status code is not handled or not allowed
2026-01-10 20:22:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deep-well-horizontal-coolers-dw-frosty-brew-50w-dw49-b-29>: HTTP status code is not handled or not allowed
2026-01-10 20:22:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-50-basis-weight-kra-paper>: HTTP status code is not handled or not allowed
2026-01-10 20:22:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-sheet-12-l-x-12-w-x-1-thick-black-bulk-ps-acb-1941>: HTTP status code is not handled or not allowed
2026-01-10 20:22:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyethylene-90-130-micron-fritware-immersion-filters-40mm-diameter-2pk>: HTTP status code is not handled or not allowed
2026-01-10 20:22:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-solid-plastic-shelving-unit-nexelon-posts-18-w-x-36-l-x-63-h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-24-l-x-4-w-x-2-1-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 20:22:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sealless-combination-tool-for-5-8-steel-strapping-mul-16-58>: HTTP status code is not handled or not allowed
2026-01-10 20:22:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-24-l-x-2-w-x-2-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 20:22:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyethylene-jerrican-with-spigot-10-liters-25-gallons-screw-cap-3-4-id-spout>: HTTP status code is not handled or not allowed
2026-01-10 20:22:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-1lb-paper-bag-30lb-kraft-brown-3-1-2-x-6-7-8-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:22:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-5lb-paper-bag-35lb-kraft-brown-5-1-4-x-3-7-16-x-10-15-16-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:22:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-general-purpose-liquid-in-glass-thermometer-20-to-150c-total-immersion>: HTTP status code is not handled or not allowed
2026-01-10 20:22:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-calibrated-dry-block-incubator-liquid-in-glass-thermometer-18-to-60c-35mm-immersion>: HTTP status code is not handled or not allowed
2026-01-10 20:22:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kendall-howard-1032-rack-screws-50>: HTTP status code is not handled or not allowed
2026-01-10 20:22:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-24-8-drawer-2-cabinets-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:22:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/29d-undercounter-refrigerator-food-prep-48w-ucr48a>: HTTP status code is not handled or not allowed
2026-01-10 20:22:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bumpon-resiliant-rollstock-sj6232-4-1-2-x-72-yds-black-1-16-thick-70006459435>: HTTP status code is not handled or not allowed
2026-01-10 20:22:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-partition-gray-36-1-4x60>: HTTP status code is not handled or not allowed
2026-01-10 20:22:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aed-pediatric-use-decal-set-10pack>: HTTP status code is not handled or not allowed
2026-01-10 20:22:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-5-tier-42w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/basic-aed-responder-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:22:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-5-tier-54w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-36-l-x-6-w-x-3-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 20:22:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bumpon-protective-product-sj6105-square-1-280-w-x-0-250-l-black-pkg-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:22:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x-10ft-tough-tex-174-us-flag-with-sewn-stripes-embroidered-stars>: HTTP status code is not handled or not allowed
2026-01-10 20:22:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bumpon-resiliant-rollstock-sj5832-4-1-2-x-72-yds-black-1-32-thick-70006459799>: HTTP status code is not handled or not allowed
2026-01-10 20:22:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-sheet-12-l-x-12-w-x-1-4-thick-black-bulk-ps-acb-1749>: HTTP status code is not handled or not allowed
2026-01-10 20:22:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bumpon-resiliant-rollstock-sj5816-9-x-36-yds-black-1-16-thick-70006459898>: HTTP status code is not handled or not allowed
2026-01-10 20:22:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-labeled-2-color-acetone-wide-mouth-wash-bottles-500ml-16oz-pe-w-red-pp-cap-6pk>: HTTP status code is not handled or not allowed
2026-01-10 20:22:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-voltage-digital-7-day-programmable-thermostat-p711-1-stage-heat-1-cool-24-vac>: HTTP status code is not handled or not allowed
2026-01-10 20:22:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-hay-rack-corner-stall-feeder-enclosed-back-w-rounded-edges-21l-x24h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-5-tier-72w-x-30d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ge-100es-2rs-spherical-plain-bearing-metric-sealed>: HTTP status code is not handled or not allowed
2026-01-10 20:22:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-24-l-x-5-w-x-1-4-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:22:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/horizontal-or-vertical-discharge-fan-forced-suspended-unit-heater-3300w-277v>: HTTP status code is not handled or not allowed
2026-01-10 20:22:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-5662-15a-250v-industrial-series-heavy-duty-grade-duplex-receptacle-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:22:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-24-l-x-3-w-x-2-3-4-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:22:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-36-l-x-2-w-x-1-2-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:22:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-sheet-48-l-x-24-w-x-2-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:22:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-36-l-x-5-w-x-3-4-thick-white>: HTTP status code is not handled or not allowed
2026-01-10 20:22:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/radiant-ceiling-panel-375w-120-240v>: HTTP status code is not handled or not allowed
2026-01-10 20:22:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-tite-banner-hangers-24l-x-12w-white>: HTTP status code is not handled or not allowed
2026-01-10 20:22:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-5-tier-24w-x-24d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-5-tier-48w-x-21d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-5-tier-30w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-wooden-market-umbrella-blue-1>: HTTP status code is not handled or not allowed
2026-01-10 20:22:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-60w-x-36d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-payoff-stand>: HTTP status code is not handled or not allowed
2026-01-10 20:22:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-5-tier-48w-x-36d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-5-tier-60w-x-21d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-72w-x-30d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-center-with-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:22:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-abs-bar-36-l-x-4-w-x-3-4-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:22:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tray-and-shelf-fold-storage-with-25-clear-trays>: HTTP status code is not handled or not allowed
2026-01-10 20:22:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crack-stix-125-ft-medium-half-inch-permanent-blacktop-crack-filler-2050>: HTTP status code is not handled or not allowed
2026-01-10 20:22:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-72w-x-21d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-48w-x-14d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/attachment-for-aluminum-dockboards-with-steel-curbs-986862>: HTTP status code is not handled or not allowed
2026-01-10 20:22:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4800-4800n95-series-airwave-n95-particulate-respirator-ov-ozone-relief-m-l-8-box>: HTTP status code is not handled or not allowed
2026-01-10 20:22:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-36w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:22:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spinbar-teflon-elliptical-egg-shaped-magnetic-stirring-bar-159-x-635mm-white>: HTTP status code is not handled or not allowed
2026-01-10 20:23:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reelcraft-l-nm450-163-x-nema-4-heavy-duty-power-cord-reel-16-gauge-3-conductor-9-amps-50-feet-cord-with-flying-leads>: HTTP status code is not handled or not allowed
2026-01-10 20:23:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-muff-headset-w-in-line-ptt>: HTTP status code is not handled or not allowed
2026-01-10 20:23:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9520-46m-12-inch-axial-dc-plastic-blower-system-w-12-inch-mvp-9546-blower>: HTTP status code is not handled or not allowed
2026-01-10 20:23:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mounting-kit-with-18-w-36-w-louvers-72-w-workbench-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:23:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/riga-v-greenhouse-17-2l-x-9-8w-x-7-6h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mounting-kit-with-18-wlouver-36-w-pegboard-60-w-workbench-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:23:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x-20-super-heavy-duty-brown-tarp-8-oz-269906>: HTTP status code is not handled or not allowed
2026-01-10 20:23:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tmx-universal-live-center-mt3-5000-rpm-tmx>: HTTP status code is not handled or not allowed
2026-01-10 20:23:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spinbar-teflon-octagon-magnetic-stirring-bar-127-x-8mm-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:23:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-add-on-unit-72w-x-14d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-deep-file-file-mobile-pedestal-white>: HTTP status code is not handled or not allowed
2026-01-10 20:23:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-electric-heater-45000-watts>: HTTP status code is not handled or not allowed
2026-01-10 20:23:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-bar-48-l-x-4-w-x-1-4-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:23:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-60w-x-21d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19260 pages (at 97 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:23:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iso-16028-nipple-14-body-size-14-npt-female>: HTTP status code is not handled or not allowed
2026-01-10 20:23:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-wide-welded-steel-locker-triple-tier-24x24x74-3-door-gray-2>: HTTP status code is not handled or not allowed
2026-01-10 20:23:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-face-out-w-disc-at-end-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:23:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-round-amber-flood-light-12-24vdc-54-leds-1492111>: HTTP status code is not handled or not allowed
2026-01-10 20:23:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-roll-600-l-x-12-w-x-1-32-thick-black-50a>: HTTP status code is not handled or not allowed
2026-01-10 20:23:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-tile-top-antifatigue-mat-7-8-thick-4-wide-up-to-60-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:23:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-knife-bracket-shiny-black>: HTTP status code is not handled or not allowed
2026-01-10 20:23:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-48w-x-21d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-square-clear-flood-light-24-24vdc-9-leds-1492119>: HTTP status code is not handled or not allowed
2026-01-10 20:23:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transparent-pvc-covers-letter-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:23:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-plastic-binding-combs-letter-size-55-sheet-capacity-3-8-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:23:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truck-box-mounting-bracket-1701006>: HTTP status code is not handled or not allowed
2026-01-10 20:23:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-5-tier-42w-x-24d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-304-stainless-steel-locker-12w-x-18d-x-78h-six-tier-1-wide-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:23:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jet-electric-chain-hoist-1-ton-20-li-3-phase-230-460v>: HTTP status code is not handled or not allowed
2026-01-10 20:23:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-add-on-18605b-60w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stainless-steel-wire-shelving-starter-5-tier-60w-x-21d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sta-put-rubber-mudflaps-24x36-b36spp>: HTTP status code is not handled or not allowed
2026-01-10 20:23:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delrin-acetal-bar-36-l-x-1-1-2-w-x-5-8-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:23:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-add-on-24545b-54w-x-24d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-14-gauge-extra-heavy-duty-galvanite-duratough-storage-cabinet-60w-x-24d-x-78h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-acetal-bar-24-l-x-1-w-x-1-4-thick-off-white-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:23:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-extra-heavy-duty-galvanite-duratough-addl-shelf-48w-x-24d>: HTTP status code is not handled or not allowed
2026-01-10 20:23:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-sheet-24-l-x-12-w-x-3-16-thick-clear-antistatic>: HTTP status code is not handled or not allowed
2026-01-10 20:23:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-abs-bar-24-l-x-4-w-x-1-4-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:23:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cable-truck-step-perforated-step-12-inch-wx12-inch-h-5231212>: HTTP status code is not handled or not allowed
2026-01-10 20:23:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spinstar-teflon-magnetic-stirring-bar-62mm-fits-250ml-beakers-white>: HTTP status code is not handled or not allowed
2026-01-10 20:23:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-square-clear-flood-light-12-24vdc-5-leds-1492117>: HTTP status code is not handled or not allowed
2026-01-10 20:23:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-plastic-ladle-50ml-9-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:23:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-stacking-bins-19-7-8-x-36-x-17-1-2-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:23:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-4-way-rack-satin-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:23:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-sample-thief-475ml-41-1-2-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:23:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/competitor-ventilated-three-tier-locker-starter-1-wide-12w-x-12d-x-24h-unassembled-almond>: HTTP status code is not handled or not allowed
2026-01-10 20:23:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lk60-chrome-continuous-waste-drain-for-3-compartment-sink>: HTTP status code is not handled or not allowed
2026-01-10 20:23:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-ptfe-rod-36-l-x-2-dia-off-white-glass-filled>: HTTP status code is not handled or not allowed
2026-01-10 20:23:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/splice-tee-kit-waterproof>: HTTP status code is not handled or not allowed
2026-01-10 20:23:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-optional-upright-for-dmb-1-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:23:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/squeezer-multipurpose-cable-lockout-7244>: HTTP status code is not handled or not allowed
2026-01-10 20:23:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-18605b-60w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-china-bristle-chip-brush-1-2>: HTTP status code is not handled or not allowed
2026-01-10 20:23:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/140010-rope-kit-ss-5m-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:23:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/132007-smc-h-coded-non-contact-switch-wled-10m-2nc-1no>: HTTP status code is not handled or not allowed
2026-01-10 20:23:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-silicone-lube>: HTTP status code is not handled or not allowed
2026-01-10 20:23:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-18305b-30w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/26-pc-wall-storage-unit-brown-interlock-poly-bins-wall-mount-rails-w-hardware-2-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:23:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-24245b-24w-x-24d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sterile-cloning-cylinders-12mm-top-x-13mm-bottom-od-plastic-50pk>: HTTP status code is not handled or not allowed
2026-01-10 20:23:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-teflon-fep-steel-forceps-1-1-2-coated-tip-3-7-8-length-2pk>: HTTP status code is not handled or not allowed
2026-01-10 20:23:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-add-on-18365b-36w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:23:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10020acad-ultra-quiet-oil-free-2-0-hp-10-0-gal-air-compressorw-auto-drain>: HTTP status code is not handled or not allowed
2026-01-10 20:23:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/136008-wmr-magnetic-non-contact-switch-8way-2nc-1no-m12>: HTTP status code is not handled or not allowed
2026-01-10 20:23:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-sterileware-plastic-mini-tongs-4-1-4-sterile-individually-wrapped-25pk>: HTTP status code is not handled or not allowed
2026-01-10 20:23:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20015hpad-ultra-quiet-oil-free-15-hp-20-gal-175-psi-two-stage-air-compressor>: HTTP status code is not handled or not allowed
2026-01-10 20:23:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40-gal-steel-decorative-square-waste-receptacle-stainless-steel-cl40-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:23:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-roll-480-l-x-36-w-x-1-2-thick-black-high-strength-80a>: HTTP status code is not handled or not allowed
2026-01-10 20:23:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20020ad-ultra-quiet-oil-free-air-compressor2-0-hp-20-0-gal-air-compressor>: HTTP status code is not handled or not allowed
2026-01-10 20:23:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-sheet-36-l-x-12-w-x-1-32-thick-black-high-strength-80a>: HTTP status code is not handled or not allowed
2026-01-10 20:23:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20040spcad-ultra-quiet-oil-free-4-0-hp-20-0-gal-air-compressor>: HTTP status code is not handled or not allowed
2026-01-10 20:23:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/232101-esl-ssp-replacement-lid-wshroud-padlock-holes-8l-x-6w-x-4h-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:23:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cuso-wh-led-outdoor-emergency-light-3000k-nicad-batt-wet-loc-white>: HTTP status code is not handled or not allowed
2026-01-10 20:23:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-sheet-12-l-x-12-w-x-3-32-thick-black-high-strength-80a>: HTTP status code is not handled or not allowed
2026-01-10 20:23:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sg2-50-pcu-led-low-profile-wall-pack-w-photocontrol-51w-5500l-5000k-dark-bronze-dlc>: HTTP status code is not handled or not allowed
2026-01-10 20:23:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-double-tier-locker-starter-1-wide-15w-x-15d-x-36h-unassembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:23:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72-x-36-maple-square-edge-mobile-production-bench-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:23:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ml-2l3k-1-db-led-floodlight-w-occ-sensor-26-6w-2100l-3000k-120v-dk-bronze>: HTTP status code is not handled or not allowed
2026-01-10 20:23:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seq-dual-speed-electric-chain-hoist-1-8-ton-20-lift-56-9-3-ft-min-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:23:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12v-35a-sealed-lead-acid-replacement-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:23:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-30-plastic-safety-edge-mobile-production-bench-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:23:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/competitor-ventilated-three-tier-locker-2-wide-12w-x-12d-x-24h-assembled-almond>: HTTP status code is not handled or not allowed
2026-01-10 20:23:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seq-dual-speed-electric-chain-hoist-w-push-trolley-1-8-ton-20-lift-56-9-3-ft-min-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:23:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-roll-600-l-x-12-w-x-1-16-thick-black-ultra-strength-70a>: HTTP status code is not handled or not allowed
2026-01-10 20:23:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/competitor-ventilated-three-tier-locker-3-wide-12w-x-12d-x-24h-assembled-almond>: HTTP status code is not handled or not allowed
2026-01-10 20:23:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enclosed-cork-board-72-x-48-3-door>: HTTP status code is not handled or not allowed
2026-01-10 20:23:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-three-tier-locker-1-wide-12w-x-12d-x-24h-assembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:23:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/404201-rfid-coded-non-contact-switch-lp-replacement-act-master>: HTTP status code is not handled or not allowed
2026-01-10 20:23:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/142063-gls-rope-pull-switch-we-stops-3nc-1no-12npt-die-cast>: HTTP status code is not handled or not allowed
2026-01-10 20:23:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/140014-rope-kit-ss-30m-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:23:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-dia-round-folding-rack-rectangular-tubing-matte-black>: HTTP status code is not handled or not allowed
2026-01-10 20:23:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-fiberglass-step-ladder-250-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:23:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/144004-gls-ss-rope-pull-switch-2nc-2no-12npt-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:24:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-five-tier-locker-2-wide-12w-x-15d-x-12h-assembled-blue-frost>: HTTP status code is not handled or not allowed
2026-01-10 20:24:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-four-tier-locker-3-wide-12w-x-18d-x-15h-assembled-almond>: HTTP status code is not handled or not allowed
2026-01-10 20:24:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-3-panel-corner-room-divider-60-1-4-w-x-43-1-2-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:24:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20d-x-24w-x-38h-register-stand-white>: HTTP status code is not handled or not allowed
2026-01-10 20:24:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eq-dual-speed-electric-chain-hoist-w-push-trolley-1-ton-10-lift-23-3-8-ft-min-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:24:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seq-dual-speed-electric-chain-hoist-1-4-ton-20-lift-33-5-5-ft-min-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:24:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-3-panel-corner-room-divider-60-1-4-w-x-73-1-2-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:24:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/max-attach-polymagnet-rare-earth-disc-0-75-dia-x-0-06-thick>: HTTP status code is not handled or not allowed
2026-01-10 20:24:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-roll-1440-l-x-36-w-x-1-32-thick-black-high-strength-90a>: HTTP status code is not handled or not allowed
2026-01-10 20:24:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stopper-tubing-sizer>: HTTP status code is not handled or not allowed
2026-01-10 20:24:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-head-t-knob-thumb-screw-m8-x-1-25-30mm-thread-45mm-head-dia-24mm-head-h-pkg-of-5>: HTTP status code is not handled or not allowed
2026-01-10 20:24:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solvent-base-street-utility-marking-paint-20-oz-white-20-952-12-case>: HTTP status code is not handled or not allowed
2026-01-10 20:24:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-strip-120-l-x-1-4-w-x-1-8-thick-black-high-strength-80a>: HTTP status code is not handled or not allowed
2026-01-10 20:24:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drain-auger-3-8-x-25>: HTTP status code is not handled or not allowed
2026-01-10 20:24:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-heavy-weight-single-slot-w-1-2-slots-on-1-centers-satin-zinc>: HTTP status code is not handled or not allowed
2026-01-10 20:24:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19354 pages (at 94 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:24:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-thumb-screw-w-shoulder-4-40-1-4-thread-3-8-head-dia-steel-pkg-of-5>: HTTP status code is not handled or not allowed
2026-01-10 20:24:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lf-brass-full-port-ball-valve-threaded-1-1-4>: HTTP status code is not handled or not allowed
2026-01-10 20:24:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-series-street-utility-marking-paint-20-oz-blue-fluorescent-20-369-12-case>: HTTP status code is not handled or not allowed
2026-01-10 20:24:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/core-cl-suture-procedure-cart-with-locking-sliding-door-white-withblack>: HTTP status code is not handled or not allowed
2026-01-10 20:24:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-single-tier-locker-3-wide-12w-x-15d-x-60h-assembled-almond>: HTTP status code is not handled or not allowed
2026-01-10 20:24:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-heavy-weight-single-slot-w-1-2-slots-on-1-centers-satin-zinc>: HTTP status code is not handled or not allowed
2026-01-10 20:24:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coil-cord-12-ft-09680-thermoplastic-elastomer-snap-socket-black>: HTTP status code is not handled or not allowed
2026-01-10 20:24:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-side-double-notch-action-sealer-for-1w-x-1thickness>: HTTP status code is not handled or not allowed
2026-01-10 20:24:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-thumb-screw-w-shoulder-m5-x-0-8-9mm-thread-11-1mm-head-dia-steel-pkg-of-5>: HTTP status code is not handled or not allowed
2026-01-10 20:24:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultrasonic-thickness-gauge-0-05-7-9-inch-1-5-200mm>: HTTP status code is not handled or not allowed
2026-01-10 20:24:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1w-x-5h-grid-panel-semi-gloss-black>: HTTP status code is not handled or not allowed
2026-01-10 20:24:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/allen-rotary-style-gasket-cutter-ax7000-portable-vise-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:24:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-brass-thumb-screw-w-shoulder-8-32-3-8-thread-1-2-head-dia-pkg-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:24:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-shower-curtain-rod-stainless-steel-9538-036000>: HTTP status code is not handled or not allowed
2026-01-10 20:24:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-sheet-12-l-x-12-w-x-3-8-thick-black-high-strength-90a-bulk-rs-h90-34>: HTTP status code is not handled or not allowed
2026-01-10 20:24:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-head-t-knob-thumb-screw-1-4-20-59-thread-1-38-head-dia-71-head-h-pkg-of-5>: HTTP status code is not handled or not allowed
2026-01-10 20:24:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-40-3-gauge-vinyl-taffeta-w-window-zipper-beige-w-beige-trim>: HTTP status code is not handled or not allowed
2026-01-10 20:24:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-grid-hook-semi-gloss-white>: HTTP status code is not handled or not allowed
2026-01-10 20:24:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-buna-n-roll-1440-l-x-36-w-x-3-8-thick-black-high-strength-90a>: HTTP status code is not handled or not allowed
2026-01-10 20:24:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-cast-acrylic-sheet-96-l-x-48-w-x-1-4-thick-red-ps-cacc-9>: HTTP status code is not handled or not allowed
2026-01-10 20:24:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-netting-three-bay-6>: HTTP status code is not handled or not allowed
2026-01-10 20:24:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cm-1133-74-one-by-one-rotating-cup-and-lid-organizer-10-inch-w-x-10-inch-d-x-15-3-4-inch-h-platinum>: HTTP status code is not handled or not allowed
2026-01-10 20:24:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mount-anywhere-basket-18-12-4-w>: HTTP status code is not handled or not allowed
2026-01-10 20:24:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mount-anywhere-basket-24-12-8-b>: HTTP status code is not handled or not allowed
2026-01-10 20:24:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/osc-625-oil-water-separator-1323-cfm-10-ppm-3-4-npt-outlet-organoclay>: HTTP status code is not handled or not allowed
2026-01-10 20:24:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-netting-three-bay-22>: HTTP status code is not handled or not allowed
2026-01-10 20:24:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-pvc-type-1-tube-72-l-x-5-8-id-x-1-1-8-od-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:24:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pressure-sensitive-polyurethane-foam-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:24:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jumbo-economy-metal-bookends-black-enamel>: HTTP status code is not handled or not allowed
2026-01-10 20:24:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/174-tht-179-494-or-b-494-color-polyester-labels-1-h-x-1-w-orange-white-3000-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:24:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desk-protector-organizer-17-x-21-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:24:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-340ex-6g5-explosion-proof-6-inch-vibrating-bell-24v-ac>: HTTP status code is not handled or not allowed
2026-01-10 20:24:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usa-neoprene-roll-720-l-x-16-w-x-1-4-thick-black-50a>: HTTP status code is not handled or not allowed
2026-01-10 20:24:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-acrylic-pencil-holder>: HTTP status code is not handled or not allowed
2026-01-10 20:24:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/genuine-oak-stackable-desk-tray-letter-double-deep-5h-mahogany-finish>: HTTP status code is not handled or not allowed
2026-01-10 20:24:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-174-chrome-ledge-solid-shelves-24-w-x-4-h>: HTTP status code is not handled or not allowed
2026-01-10 20:24:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/66000-lab-x-series-extra-wide-blood-drawing-chair-with-padded-arms>: HTTP status code is not handled or not allowed
2026-01-10 20:24:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vertical-plate-clamp-with-chain-li-ing-attachment-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:24:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-96br-n5-small-xenon-strobe-red-120v-ac>: HTTP status code is not handled or not allowed
2026-01-10 20:24:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp4308t-40-hp-1190-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:24:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/horizontal-plate-clamp-li-ing-attachement-2000-lb-capapcity>: HTTP status code is not handled or not allowed
2026-01-10 20:24:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp4312t-50-hp-1185-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:24:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30629-shim-254-mm-od-x-19-mm-od-x-005-mm-thick-1-pkg-qty>: HTTP status code is not handled or not allowed
2026-01-10 20:24:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/luminice-ii-growth-inhibitor-kit-for-neo-models-undercounter-ice-machines>: HTTP status code is not handled or not allowed
2026-01-10 20:24:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a1334-random-orbital-sander-non-vacuum-shroud-3-1-pkg-qty>: HTTP status code is not handled or not allowed
2026-01-10 20:24:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/belt-drive-motor-3-4-hp-1725-rpm-115v-odp-k56-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:24:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-125xbrmb24db-125xbr-xtra-brite-led-multi-mode-blue-24-vdc>: HTTP status code is not handled or not allowed
2026-01-10 20:24:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-2705w240v25pk-5w-incandescent-bulb-for-70-mm-stacklight-240v-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:24:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-hinged-top-basket-truck-10-bu-red-vinyl-wood-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 20:24:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72x24-maple-square-edge-production-bench-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:24:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/condenser-fans-motor-1-hp-1075-rpm-208-230-460v-oao>: HTTP status code is not handled or not allowed
2026-01-10 20:24:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-hinged-top-basket-truck-16-bu-orange-vinyl-wood-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 20:24:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screen-cloth-1-1-2-x-25-yds>: HTTP status code is not handled or not allowed
2026-01-10 20:24:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signal-5531m-24y6-multi-tone-electronic-signal-4-inputs-4-outputs-24v-input-120-240v-ac>: HTTP status code is not handled or not allowed
2026-01-10 20:24:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/174-j20-260-2595-153-vinyl-label-3-35-h-x-2-17-w-340-roll-white>: HTTP status code is not handled or not allowed
2026-01-10 20:24:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-5532m-n5-remote-speaker-amplifier-120v-ac>: HTTP status code is not handled or not allowed
2026-01-10 20:24:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp3660t-4-3-hp-3500-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:24:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/water-pump-sk-329-110v-60hz-cube-ice-machine>: HTTP status code is not handled or not allowed
2026-01-10 20:24:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ice-full-sensor-sk-129-169-219-289-110v-60hz-cube-ice-machines>: HTTP status code is not handled or not allowed
2026-01-10 20:24:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-products-mn-ms90-b2020-90-shade-cloth-shade-tarp-20-x-20>: HTTP status code is not handled or not allowed
2026-01-10 20:24:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-hinged-top-basket-truck-24-bu-yellow-vinyl-wood-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 20:24:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/marble-plus-plumbers-putty-3-lb>: HTTP status code is not handled or not allowed
2026-01-10 20:24:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-270mda120a-70-mm-magnetodynamic-sounder-gray-120v-ac>: HTTP status code is not handled or not allowed
2026-01-10 20:24:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/room-air-conditioner-motor-1-10-hp-1625-rpm-208-230v-oao>: HTTP status code is not handled or not allowed
2026-01-10 20:24:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-hinged-top-basket-truck-8-bu-yellow-vinyl-wood-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 20:24:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-hinged-top-basket-truck-18-bu-yellow-vinyl-wood-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 20:24:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-lightweight-aluminum-tinner-snips>: HTTP status code is not handled or not allowed
2026-01-10 20:24:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stretch-fabric-table-cover-black-four-feet>: HTTP status code is not handled or not allowed
2026-01-10 20:24:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp2332t-10-hp-1180-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:24:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filament-tape-898-36mm-x-55m-6-6-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:24:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100-professional-aluminum-chalk-reel-blue-chalk>: HTTP status code is not handled or not allowed
2026-01-10 20:24:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-hinged-top-basket-truck-10-bu-black-vinyl-wood-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 20:24:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-outdoor-steel-flat-bench-expanded-metal-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:24:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-long-aluminum-construction-pipe-safety-railing>: HTTP status code is not handled or not allowed
2026-01-10 20:24:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pvc-hinged-top-basket-truck-16-bu-tan-vinyl-wood-base-all-swivel>: HTTP status code is not handled or not allowed
2026-01-10 20:24:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp4108t-4-30-hp-3520-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:24:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fork-truck-air-jack>: HTTP status code is not handled or not allowed
2026-01-10 20:24:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-outdoor-steel-bench-with-backrest-expanded-metal-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:24:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ecp2334t-4-20-hp-1765-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:24:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-270ledsy24ad-smd-steady-led-module-and-light-source-yellow-24v-acdc>: HTTP status code is not handled or not allowed
2026-01-10 20:24:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adhesive-transfer-tape-969-1-4-x-18-yds-5-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:24:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-general-purpose-three-phase-tefc-motor-3-4-hp-1725-rpm-208-230-460v-tefc>: HTTP status code is not handled or not allowed
2026-01-10 20:24:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/specialty-molded-dock-bumper-8-wx18-lx2-h-1>: HTTP status code is not handled or not allowed
2026-01-10 20:25:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1010546-flip-out-bin-mobile-parts-cart-single-sided-with-40-bins>: HTTP status code is not handled or not allowed
2026-01-10 20:25:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1010500-bin-compartment-case-1-sided-11-locking-bins-15-1-2-l-x-16-w-x-2-3-4-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:25:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/edwards-signaling-125xbrmr24d-125xbr-xtra-brite-led-multi-mode-red-24-vdc-0215-amps>: HTTP status code is not handled or not allowed
2026-01-10 20:25:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/90-tooth-dual-material-locking-flex-head-teardrop-ratchet-with-1-4-drive-tang-8>: HTTP status code is not handled or not allowed
2026-01-10 20:25:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastek-conductive-fluted-sheet-3mm-x-36-x-48-black>: HTTP status code is not handled or not allowed
2026-01-10 20:25:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magnetic-label-holder-1-1-8-x-100-scored-1-1-8-x-3-400-pieces-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:25:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/45-ez-grab-flared-black-post--2-3-high-intensity-prismatic-collars>: HTTP status code is not handled or not allowed
2026-01-10 20:25:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-aom3708t-5airover-hp-1150-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/li-tilt-scissor-table-1>: HTTP status code is not handled or not allowed
2026-01-10 20:25:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rapidguard-2-run-post-6-3-4-h>: HTTP status code is not handled or not allowed
2026-01-10 20:25:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-elevating-spring-table-5>: HTTP status code is not handled or not allowed
2026-01-10 20:25:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-box-dumper-3>: HTTP status code is not handled or not allowed
2026-01-10 20:25:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbl-rivet-boltless-shelving-48wx30dx84h-4-levels-starter-no-decking-750-lbs-shelf-cap-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:25:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/direct-drive-motor-1-4-hp-1050-rpm-115v-oao>: HTTP status code is not handled or not allowed
2026-01-10 20:25:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-log-book-for-electric-narrow-aisle-forklift-log-986886>: HTTP status code is not handled or not allowed
2026-01-10 20:25:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19452 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:25:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ssc-series-electric-chain-hoist-2-ton-20-ft-lift-230v-460v>: HTTP status code is not handled or not allowed
2026-01-10 20:25:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-boltless-shelving-w-center-support-72-inch-w-x-24-inch-d-1-level-w-o-decking-black>: HTTP status code is not handled or not allowed
2026-01-10 20:25:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-premium-photo-paper-13in-x-19in-white-50-sheets-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:25:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extruded-bumper-4-25-w-x-36-l-x-4-h>: HTTP status code is not handled or not allowed
2026-01-10 20:25:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storm-sentinel-catch-basin-insert-round-27-to-29-diameter>: HTTP status code is not handled or not allowed
2026-01-10 20:25:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-three-phase-tefc-motor-2-hp-1760-rpm-230-460v-tefc>: HTTP status code is not handled or not allowed
2026-01-10 20:25:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/counter-height-industrial-cabinet-36-w-x-24-d-x-45-h-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:25:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-plus-photo-paper-4in-x-6in-white-100-sheets-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:25:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-unit-heater-motor-1-6-hp-1075-rpm-115v-teao>: HTTP status code is not handled or not allowed
2026-01-10 20:25:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-color-copy-cover-paper-photo-white-18in-x-12in-1-000-sheets-carton>: HTTP status code is not handled or not allowed
2026-01-10 20:25:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-rivet-boltless-shelving-48-inch-w-x-30-inch-d-x-84-inch-h-5-levels-add-on-w-o-decking-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:25:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transformer-cooling-fan-motor-1-3-hp-1075-rpm-115-200-230v-teao>: HTTP status code is not handled or not allowed
2026-01-10 20:25:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clearview-industrial-cabinet-48-w-x-24-d-x-75-h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:25:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/auger-drive-motor-1-hp-1725-rpm-115-230v-tefc>: HTTP status code is not handled or not allowed
2026-01-10 20:25:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-full-size-housekeeping-cart-with-doors-2>: HTTP status code is not handled or not allowed
2026-01-10 20:25:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-classic-full-size-housekeeping-cart-1>: HTTP status code is not handled or not allowed
2026-01-10 20:25:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-rivet-boltless-shelving-48-inch-w-x-18-inch-d-x-84-inch-h-7-levels-add-on-w-o-decking-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:25:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/condenser-fans-motor-3-4-hp-1075-rpm-460v-teao-48-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:25:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/record-storage-shelving-42-inch-w-x-15-inch-d-x-84-inch-h-4-levels-add-on-w-o-decking-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:25:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-oem-replacement-motor-1-5-hp-825-rpm-208-230v-teao>: HTTP status code is not handled or not allowed
2026-01-10 20:25:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/men-indus-wrk-shirt-shrt-slv-whte-m-sp24>: HTTP status code is not handled or not allowed
2026-01-10 20:25:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-flow-control-cylinder-flow-screw-adjustment-5-32-tube-x-1-8-universal-thread-5-6-l>: HTTP status code is not handled or not allowed
2026-01-10 20:25:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/farm-duty-cow-cooler-motor-1-hp-1725-rpm-230v-teao>: HTTP status code is not handled or not allowed
2026-01-10 20:25:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-straight-male-internal-hex-4mm-tube-x-m5-unf-2-5-l>: HTTP status code is not handled or not allowed
2026-01-10 20:25:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/farm-duty-single-phase-motor-1-hp-1725-rpm-230-115v-tefc>: HTTP status code is not handled or not allowed
2026-01-10 20:25:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/direct-drive-motor-1-4-hp-1625-rpm-115v-oao>: HTTP status code is not handled or not allowed
2026-01-10 20:25:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-with-electronic-lock-with-digital-screen-36-w-x-24-d-x-75-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:25:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-chc3416a-33-hp-1700-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbl-rivet-boltless-shelving-72wx30dx84h-4-levels-add-on-no-decking-1000-lbs-shelf-cap-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:25:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-polymer-shelf-with-grid-mat-30-w-x-21-d>: HTTP status code is not handled or not allowed
2026-01-10 20:25:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/length-divider-442199-442200-price-per-pkg-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:25:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-elbow-3-8-tube-x-1-8-swift-fit-universal-thread-1-l>: HTTP status code is not handled or not allowed
2026-01-10 20:25:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toolbox-t700-white-jumbo-roll-870-sheets-roll-1-roll-case-78300>: HTTP status code is not handled or not allowed
2026-01-10 20:25:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oem-replacement-motor-3-4-hp-1075-rpm-460v-oao-48y-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:25:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-cem3584t-5-1-5-hp-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-boltless-shelving-48-inch-w-x-48-inch-d-x-84-inch-h-3-levels-starter-w-o-decking-black>: HTTP status code is not handled or not allowed
2026-01-10 20:25:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-return-table-cherry>: HTTP status code is not handled or not allowed
2026-01-10 20:25:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-polymer-shelf-with-solid-mat-60-w-x-18-d>: HTTP status code is not handled or not allowed
2026-01-10 20:25:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-with-electronic-lock-with-digital-screen-48-w-x-24-d-x-75-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:25:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jm-motor-1-1-2-hp-1755-rpm-230-460v-odp-145jmv-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:25:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-kbm3454-25-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-heavyweight-vinyl-sheet-protector-clear-11-x-8-1-2-50-bx>: HTTP status code is not handled or not allowed
2026-01-10 20:25:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-run-tee-1-2-tube-x-3-8-swift-fit-universal-thread-1-1-5-l>: HTTP status code is not handled or not allowed
2026-01-10 20:25:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-idnm3587t-2te-hp-5500-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-high-container-2000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:25:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-elbow-5-32-tube-x-1-4-nptf-2-3-l>: HTTP status code is not handled or not allowed
2026-01-10 20:25:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/one-door-indoor-letterboard-18-x-24-x-2>: HTTP status code is not handled or not allowed
2026-01-10 20:25:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-union-8mm-tube-7-8-l>: HTTP status code is not handled or not allowed
2026-01-10 20:25:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-uniform-cabinet-with-4-shelves-48-w-x-24-d-x-75-h-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:25:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-l1322tm-2-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-jml1512t-10-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-series-clear-lid-for-qus236-polyethylene>: HTTP status code is not handled or not allowed
2026-01-10 20:25:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-boltless-shelving-60-inch-w-x-36-inch-d-1-level-w-ez-decking-black>: HTTP status code is not handled or not allowed
2026-01-10 20:25:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/17-3-4-x-8-1-8-x-9-wire-mesh-stack-and-hang-bin-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:25:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-kl3405-1-3-hp-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-boltless-shelving-60-inch-w-x-24-inch-d-x-84-inch-h-3-levels-add-on-w-wood-decking-black>: HTTP status code is not handled or not allowed
2026-01-10 20:25:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-with-electronic-lock-and-card-reader-60-w-x-24-d-x-75-h-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:25:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-series-divider-for-qus238-black-polyethylene>: HTTP status code is not handled or not allowed
2026-01-10 20:25:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-flow-control-cylinder-flow-screw-adjustment-1-8-tube-x-1-8-universal-thread-0-l>: HTTP status code is not handled or not allowed
2026-01-10 20:25:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-swivel-branch-tee-5mm-tube-x-1-8-swift-fit-universal-thread-1-4-7-l>: HTTP status code is not handled or not allowed
2026-01-10 20:25:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/genuine-stack-nest-tote-clear-29-1-2-l-x-19-1-2-w-x-15-h-polyprolylene>: HTTP status code is not handled or not allowed
2026-01-10 20:25:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/27062g-max-cordless-10-cultivator-40v-w-battery-charger>: HTTP status code is not handled or not allowed
2026-01-10 20:25:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-l1177t-15-hp-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flow-rack-4-shelves-with-12-span-track-flow-units-48-w-x-48-d-x-72-h-textured-black>: HTTP status code is not handled or not allowed
2026-01-10 20:25:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filter-multi-pleat-xl10-16-w-x-30-h-x-1-d-12-ctn>: HTTP status code is not handled or not allowed
2026-01-10 20:25:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-3-8-l-x-11-w-x-3-h-ultra-series-stack-and-hang-bin-black-polyethylene-3-slots>: HTTP status code is not handled or not allowed
2026-01-10 20:25:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-x-30-mobile-security-cabinet-bench-phenolic-resin-square-edge-1>: HTTP status code is not handled or not allowed
2026-01-10 20:25:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v-grip-wire-shelving-spill-containment-system-4-shelves-trays-36-w-x-18-d-x-84-h-starter-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:25:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m1210t-10-2-5-hp-1725-850-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combi-oven-41-3-8-w-x-52-3-8-d-x-40-9-16-h-208-240v-90-9a-10-shelves-manual-controls>: HTTP status code is not handled or not allowed
2026-01-10 20:25:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rivetwell-particle-board-decking-60-inch-w-x-24-inch-d-x-5-8-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:25:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-looper-orange-cone>: HTTP status code is not handled or not allowed
2026-01-10 20:25:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-x-36-reflective-roll-up-vinyl-sign-transition-symbol-right>: HTTP status code is not handled or not allowed
2026-01-10 20:25:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rivetwell-particle-board-decking-48-inch-w-x-30-inch-d-x-5-8-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:25:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rivetwell-particle-board-decking-48-inch-w-x-12-inch-d-x-5-8-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:25:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/professional-lysol-brand-iii-disinfectant-spray-4>: HTTP status code is not handled or not allowed
2026-01-10 20:25:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m1219-75-33-hp-1725-1140-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mri-safe-sawyer-instrument-table-16-l-x-20-w-x-34-h-on-casters-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:25:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m1711t-15-7-5-hp-1760-875-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:25:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-tear-drop-pallet-rack-add-on-120-w-x-48-d-x-120-h-b2282492n>: HTTP status code is not handled or not allowed
2026-01-10 20:25:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rivetwell-ez-deck-decking-69-inch-w-x-30-inch-d-x-3-4-inch-h-for-use-w-double-rivets>: HTTP status code is not handled or not allowed
2026-01-10 20:26:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-ball-valve-male-x-female-1-8-nptf-1-1-2-l>: HTTP status code is not handled or not allowed
2026-01-10 20:26:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/warming-cabinet-30-w-x-60-h-x-20-5-8-d-recessed-1-solid-door-3-adj-shelves>: HTTP status code is not handled or not allowed
2026-01-10 20:26:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hol-dex-magnetic-shelf-bin-label-holders-1-2-inch-magnetic-label-holder-10-bx>: HTTP status code is not handled or not allowed
2026-01-10 20:26:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rivetwell-ez-deck-decking-60-inch-w-x-18-inch-d-x-3-4-inch-h-for-use-w-double-rivets>: HTTP status code is not handled or not allowed
2026-01-10 20:26:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-flex-lok-antifatigue-drainage-mat-42-x120-3-sides-black-yellow-boarders>: HTTP status code is not handled or not allowed
2026-01-10 20:26:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triple-station-windsor-scrub-sink-wall-mounted-with-foot-action-control-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:26:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/record-storage-rack-add-on-letter-polyethylene-box-48-w-x-48-d-x-96-h-258219n>: HTTP status code is not handled or not allowed
2026-01-10 20:26:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-high-speed-floor-pads-natural-24>: HTTP status code is not handled or not allowed
2026-01-10 20:26:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-floor-pads-white-16>: HTTP status code is not handled or not allowed
2026-01-10 20:26:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-flow-control-flow-knob-adjustment-4mm-tube-x-1-8-universal-thread-5-6-l>: HTTP status code is not handled or not allowed
2026-01-10 20:26:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-vinyl-project-folders-with-colored-backs-11-x-8-1-2-35-bx>: HTTP status code is not handled or not allowed
2026-01-10 20:26:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ep120h-ultrasonic-cleaner-115v-with-heater-timer-drain-sweep-pulse-3-5-gallons>: HTTP status code is not handled or not allowed
2026-01-10 20:26:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-external-crescent-ring-stamped-carbon-spring-steel-phosphate>: HTTP status code is not handled or not allowed
2026-01-10 20:26:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-tear-drop-pallet-rack-add-on-96-w-x-42-d-x-144-h-b2282489n>: HTTP status code is not handled or not allowed
2026-01-10 20:26:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/record-storage-rack-add-on-letter-legal-120-w-x-36-d-x-96-h-258209n>: HTTP status code is not handled or not allowed
2026-01-10 20:26:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19548 pages (at 96 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:26:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-3-pos-ball-valve-closed-center-1-4-nptf-1-1-2-l>: HTTP status code is not handled or not allowed
2026-01-10 20:26:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-union-y-10mm-tube-1-8-9-l>: HTTP status code is not handled or not allowed
2026-01-10 20:26:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mri-safe-howard-instrument-table-20-l-x-36-w-x-34-h-on-casters-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:26:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-pf-43-1hp-1ph-115v-4-speed-4-wheel>: HTTP status code is not handled or not allowed
2026-01-10 20:26:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heated-ground-thaw-blanket-15-x-3>: HTTP status code is not handled or not allowed
2026-01-10 20:26:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-station-pedestal-lodi-scrub-sink-with-eyewash-and-digital-timer-knee-action-control>: HTTP status code is not handled or not allowed
2026-01-10 20:26:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-purity-pleated-poly-cartridge-filter-40-micron-2-34-dia-x-10h-epdm-seals-222-wfin>: HTTP status code is not handled or not allowed
2026-01-10 20:26:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/band-clamp-multi-cartridge-filter-housing-4-filter-capacity-10-14-dia-x-20h-2mnpt-connection>: HTTP status code is not handled or not allowed
2026-01-10 20:26:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-tear-drop-pallet-rack-add-on-96-w-x-48-d-x-120-h-796605n>: HTTP status code is not handled or not allowed
2026-01-10 20:26:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lx-20181b9118r-extreme-heavy-metal-cutting-saw-blade-18tpi-9-x-1-x-042-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:26:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freestanding-clear-desk-divider-acrylic-30W-x-24H>: HTTP status code is not handled or not allowed
2026-01-10 20:26:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-flow-control-flow-knob-adjustment-10mm-tube-x-1-4-universal-thread-1-1-5-l>: HTTP status code is not handled or not allowed
2026-01-10 20:26:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/104318-toughstripe-floor-marking-tape-2-inches-wide-by-100-feet-long-red-white>: HTTP status code is not handled or not allowed
2026-01-10 20:26:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knee-boot-size-11-15-h-composite-toe-chevron-plus-outsole-black>: HTTP status code is not handled or not allowed
2026-01-10 20:26:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-em3581t-1-hp-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:26:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-needle-valve-screw-adjustment-1-4-fm-nptf-x-1-4-swift-fit-universal-thread-1-l>: HTTP status code is not handled or not allowed
2026-01-10 20:26:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/atrix-omega-crevice-tool-black>: HTTP status code is not handled or not allowed
2026-01-10 20:26:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gpf492sss-0a-general-purpose-stainless-steel-solid-door-freezer-49-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:26:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20721-30-inch-heavy-duty-high-ambient-wall-fan-1-3-hp-8402-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:26:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlake-mecalux-pallet-rack-tear-drop-add-on-96-w-x-42-d-x-120-h>: HTTP status code is not handled or not allowed
2026-01-10 20:26:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrowcade-barricade-sign-stand-45-h-with-2-panel-2-sheetings-1>: HTTP status code is not handled or not allowed
2026-01-10 20:26:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-l-hook-steel-light-green-proform>: HTTP status code is not handled or not allowed
2026-01-10 20:26:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/23200-stamped-valve-tag-25-pkg-brass-1-and-a-half-inches-dia-black-brass>: HTTP status code is not handled or not allowed
2026-01-10 20:26:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-bin-holder-steel-light-green-proform>: HTTP status code is not handled or not allowed
2026-01-10 20:26:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/superfoam-antifatigue-mat-3-x2-5-8-thick-black>: HTTP status code is not handled or not allowed
2026-01-10 20:26:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlake-mecalux-pallet-rack-tear-drop-welded-upright-frame-42-d-x-192-h-green-new>: HTTP status code is not handled or not allowed
2026-01-10 20:26:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/trim-fit-knee-boot-women-s-size-10-14-h-pvc-plain-toe-cleated-outsole-navy-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:26:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterhog-eco-elite-3-wide-4-up-to-60-indigo>: HTTP status code is not handled or not allowed
2026-01-10 20:26:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-rt-angle-ball-valve-1-8-nptf-1-1-2-l>: HTTP status code is not handled or not allowed
2026-01-10 20:26:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-x-6-x-3-corrugated-boxes-200lb-test-ect-32>: HTTP status code is not handled or not allowed
2026-01-10 20:26:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/narrowcade-barricade-sign-stand-45-h-with-2-panels-no-sheeting-2>: HTTP status code is not handled or not allowed
2026-01-10 20:26:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alpha-fittings-needle-valve-screw-adjustment-1-4-tube-x-10-32-swift-fit-universal-thread-0-l>: HTTP status code is not handled or not allowed
2026-01-10 20:26:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polly-products-large-message-center-1-sided-2-posts-green>: HTTP status code is not handled or not allowed
2026-01-10 20:26:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/presto-p4-floor-level-pallet-loader-2500-lb-cap-foot-control-52-x-48>: HTTP status code is not handled or not allowed
2026-01-10 20:26:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12861-closed-top-carboy-cap-120mm-2-pkg>: HTTP status code is not handled or not allowed
2026-01-10 20:26:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/personal-emergency-preparedness-pack-corrugate>: HTTP status code is not handled or not allowed
2026-01-10 20:26:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultragravel-bag-roll-form-green-continuous-roll-11-x-250-yards>: HTTP status code is not handled or not allowed
2026-01-10 20:26:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/palmjet-12-straight-extension>: HTTP status code is not handled or not allowed
2026-01-10 20:26:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pt-shipping-tags-pre-strung-4-3-4-x-2-3-8-assorted-color>: HTTP status code is not handled or not allowed
2026-01-10 20:26:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-shipping-tag-4-3-4-x-2-3-8-white-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:26:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/propane-heater-infrared-positive-pressure-straight-tube-50000-btu-20l>: HTTP status code is not handled or not allowed
2026-01-10 20:26:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultrasidewinder-1-ft-extension-black-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:26:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-x-3-plastic-bandages-100-box>: HTTP status code is not handled or not allowed
2026-01-10 20:26:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knee-boot-men-s-size-5-15-h-composite-safety-toe-cleated-outsole-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:26:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24in-36-led-strip-light-with-3m-adhesive-back-red-5622638>: HTTP status code is not handled or not allowed
2026-01-10 20:26:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-canister-of-sugar-20-oz-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:26:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coverallzipper-fronthoodelastic-wrist-and-ankleserged-seamstormflapyellow5x>: HTTP status code is not handled or not allowed
2026-01-10 20:26:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60in-amber-modular-light-bar-with-16-led-modules-and-built-in-traffic-arrow-88930605>: HTTP status code is not handled or not allowed
2026-01-10 20:26:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/big-d-enzym-d-lemon-5-gallon-pail>: HTTP status code is not handled or not allowed
2026-01-10 20:26:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-em2276t-7-5-hp-1180-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:26:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metalin-zipper-bag-4-x-4-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:26:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coverall-hood-and-socks-boots-serged-seam-white-3x>: HTTP status code is not handled or not allowed
2026-01-10 20:26:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coverall-hood-and-socks-boots-serged-seam-white-4x>: HTTP status code is not handled or not allowed
2026-01-10 20:26:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-em2333t-8-15-hp-1765-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:26:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coffee-filter-packs-classic-roast-1-4-oz-pack-40-carton>: HTTP status code is not handled or not allowed
2026-01-10 20:26:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desiccant-pak-claytyveksilicon-dioxide-300-count-pail>: HTTP status code is not handled or not allowed
2026-01-10 20:26:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-static-high-density-conductive-foam-24-x-36-x-1>: HTTP status code is not handled or not allowed
2026-01-10 20:26:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jacket-size-tall-men-s-2t-type-r-class-3-fluorescent-yellow-green-black>: HTTP status code is not handled or not allowed
2026-01-10 20:26:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-tape-clear-with-symbols-yellow-stripe-12-x-72-yds-3-plastic-core>: HTTP status code is not handled or not allowed
2026-01-10 20:26:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desiccant-pak-claytyveksilicon-dioxide-550-count-pail>: HTTP status code is not handled or not allowed
2026-01-10 20:26:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-33in-clear-rectangular-backup-light-kit-with-32-led-5625332>: HTTP status code is not handled or not allowed
2026-01-10 20:26:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coffee-fraction-packs-lantern-glow-light-roast-2-5-oz-pack-24-packs-carton>: HTTP status code is not handled or not allowed
2026-01-10 20:26:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/green-tea-pods-1-90-oz-18-box>: HTTP status code is not handled or not allowed
2026-01-10 20:26:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-safe-utility-lid-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:26:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metalout-bag-3-mm-18-x-24-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:26:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-efm2547t-60-hp-1775-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:26:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-safe-mini-spout-lid-black>: HTTP status code is not handled or not allowed
2026-01-10 20:26:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-14in-red-surface-mount-ultra-thin-led-strobe-light-8892203>: HTTP status code is not handled or not allowed
2026-01-10 20:26:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35mm-economy-rainsuits-yellow-35mm-pvc-on-polyester-5x>: HTTP status code is not handled or not allowed
2026-01-10 20:26:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precoiled-strap-on-pipe-marker-blank-yellow-1>: HTTP status code is not handled or not allowed
2026-01-10 20:26:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metalin-zipper-bag-5-x-8-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:26:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pressure-sensitive-pipe-marker-hot-water-supply-2>: HTTP status code is not handled or not allowed
2026-01-10 20:26:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pants-fluorescent-yellow-green-polyurethane-on-75-denier-ripstop-polyester-5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:26:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-ejpm4106t-20-hp-3510-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:26:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reversible-insulated-zipper-vest-black-fl-lime-polyurethane-polyester-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:26:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-safe-premium-hand-pump-tan-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:26:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shed-spacemaker-3-x-6>: HTTP status code is not handled or not allowed
2026-01-10 20:26:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pressure-sensitive-pipe-marker-chilled-water-return-2>: HTTP status code is not handled or not allowed
2026-01-10 20:26:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rain-jacket-size-men-s-extra-small-attached-hood-green>: HTTP status code is not handled or not allowed
2026-01-10 20:26:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/executive-chair-with-flip-up-armrests-black-leather-upholstered-277492>: HTTP status code is not handled or not allowed
2026-01-10 20:26:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pivot-hinge-set-3-4-1-w-t-27-fasteners-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:26:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pressure-sensitive-pipe-marker-gasoline-3>: HTTP status code is not handled or not allowed
2026-01-10 20:27:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/valuemuffearmuff-hb-25-dielectric-nrr-25-blueblack>: HTTP status code is not handled or not allowed
2026-01-10 20:27:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/level-dependentelectronic-earmuff-with-impulse-filter-com-655-nrr-25-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:27:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quicksnapuniversal-slot-adaptor-fits-29mm-to-33mm-slotted-safety-caps-black>: HTTP status code is not handled or not allowed
2026-01-10 20:27:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-jsl525a-1-hp-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xenonsafety-glasses-sg-14c-af-clear-afpc-lens-black-framered-tips>: HTTP status code is not handled or not allowed
2026-01-10 20:27:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precoiled-strap-on-pipe-marker-oil-4>: HTTP status code is not handled or not allowed
2026-01-10 20:27:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/post-it-recycled-self-stick-easel-pad-30-sheet-25-x-30-white-paper-black-cover>: HTTP status code is not handled or not allowed
2026-01-10 20:27:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/khs-33-clip-mic-with-earphone-single-pin>: HTTP status code is not handled or not allowed
2026-01-10 20:27:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-mounts-for-flood-and-spot-lights-1492106>: HTTP status code is not handled or not allowed
2026-01-10 20:27:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hemco-base-cabinet-36-x-22-x-3214>: HTTP status code is not handled or not allowed
2026-01-10 20:27:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-5-gallon-200-psi-portable-electric-trim-air-compressor>: HTTP status code is not handled or not allowed
2026-01-10 20:27:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hemco-ductless-table-top-hood-24-x-15-x-24>: HTTP status code is not handled or not allowed
2026-01-10 20:27:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-bezel-for-3-375in-thin-mount-horizontal-strobe-light-8892321>: HTTP status code is not handled or not allowed
2026-01-10 20:27:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-3-4-smooth-shank-15-degree-coil-roofing-nails-7200-qty>: HTTP status code is not handled or not allowed
2026-01-10 20:27:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precoiled-strap-on-pipe-marker-storm-sewer-4>: HTTP status code is not handled or not allowed
2026-01-10 20:27:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19645 pages (at 97 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:27:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-174-utility-table-60-x-30-rustic-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:27:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-19in-amber-low-profile-strobe-for-narrow-grill-spacing-with-6-led-8892800>: HTTP status code is not handled or not allowed
2026-01-10 20:27:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jw-winco-aluminum-cabinet-u-handle-512-102-black>: HTTP status code is not handled or not allowed
2026-01-10 20:27:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evx-s24-two-way-radio-2-watt-analog-3-watt-digital-256-channel-uhf-403-470-mhz-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:27:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pressure-sensitive-pipe-marker-direction-arrow-blue-1>: HTTP status code is not handled or not allowed
2026-01-10 20:27:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evx-s24-two-way-radio-2-watt-analog-3-watt-digital-256-channel-uhf-403-470-mhz-black>: HTTP status code is not handled or not allowed
2026-01-10 20:27:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-to-3-1-2-33-degree-paper-tape-framing-nailer>: HTTP status code is not handled or not allowed
2026-01-10 20:27:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6212b-skirtslack-hanger-pinch-grip-wsoft-pads-12l-plastic-bk-pkg-qty-200>: HTTP status code is not handled or not allowed
2026-01-10 20:27:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-aluminum-narrow-aisle-platform-truck-1322-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:27:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-gauge-1-4-crown-1-1-4-staple-2500-qty>: HTTP status code is not handled or not allowed
2026-01-10 20:27:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/101n-wd-hanger-stacker-metal-natural-pkg-qty-1>: HTTP status code is not handled or not allowed
2026-01-10 20:27:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fellowes-9-in-neutron-rotary-trimmer>: HTTP status code is not handled or not allowed
2026-01-10 20:27:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coil-siding-nail-316-stainless-steel-1-1-2-x-090-ring-1800-qty>: HTTP status code is not handled or not allowed
2026-01-10 20:27:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2405-dress-hanger-jumbo-weight-17l-plastic-bk-pkg-qty-100>: HTTP status code is not handled or not allowed
2026-01-10 20:27:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/privacy-screen-vinyl-panel-white>: HTTP status code is not handled or not allowed
2026-01-10 20:27:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-x-1-4-hex-socket-adapter-x-2-pin-gunmetal-grey-s2-modified-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:27:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-trailer-coupler-lock-fits-most-389dat>: HTTP status code is not handled or not allowed
2026-01-10 20:27:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iron-horse-2300lb-riveted-shelving-with-wire-decking-5-shelf-72-h-x-48-w-x-18-d-black>: HTTP status code is not handled or not allowed
2026-01-10 20:27:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vl1321t-1-5-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-x-1-1-2-brass-pipe-nipple-schedule-80>: HTTP status code is not handled or not allowed
2026-01-10 20:27:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tray-camtread-9-round-black>: HTTP status code is not handled or not allowed
2026-01-10 20:27:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5mpsbk1-multi-person-bleeding-kits-8-kits-gauze-1-carry-case-1-wall-mount-case>: HTTP status code is not handled or not allowed
2026-01-10 20:27:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-faux-rattan-coffee-table-chocolate-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:27:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torq-set-8-insert-bit-x-1-s2-modified-steel-gunmetal-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:27:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30-l-folding-nose-wesco-battery-powered-cobrapro-convertible-hand-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:27:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spare-battery-module-wesco-battery-powered-cobrapro-convertible-hand-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:27:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-venm3581t-1-hp-1745-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-x-4-welded-pipe-nipple-schedule-40-304-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:27:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/height-adjustable-t-arms-for-comfortask-series-chairs-black-package-of-two>: HTTP status code is not handled or not allowed
2026-01-10 20:27:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vem3581t-1-hp-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/split-cowhide-drivers-premium-grade-keystone-thumb-gray-s>: HTTP status code is not handled or not allowed
2026-01-10 20:27:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-3-32-insert-bit-x-1-s2-modified-steel-gunmetal-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:27:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/geared-beam-trolley-2-ton-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:27:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-vinyl-sign-danger-keep-out-2>: HTTP status code is not handled or not allowed
2026-01-10 20:27:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-veuhm3558t-2-hp-1755-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-aluminum-sign-caution-confined-space-use-lockout-entry-procedures>: HTTP status code is not handled or not allowed
2026-01-10 20:27:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-vinyl-sign-danger-no-smoking-4>: HTTP status code is not handled or not allowed
2026-01-10 20:27:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-grain-cowhide-drivers-straight-thumb-premium-grade-l>: HTTP status code is not handled or not allowed
2026-01-10 20:27:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-partition-power-pass-through-cable-41-l>: HTTP status code is not handled or not allowed
2026-01-10 20:27:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phillips-square-driv-acr-2-2-insert-bit-x-1-s2-modified-steel-gunmetal-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:27:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vl1309a-1-hp-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-chain-hoist-with-overload-protection-2-ton-capacity-10-lift>: HTTP status code is not handled or not allowed
2026-01-10 20:27:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-hand-winch-with-brake-2000-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:27:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-grain-goatskin-leather-protector-for-novax-gloves-size-9>: HTTP status code is not handled or not allowed
2026-01-10 20:27:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-desk-with-hutch-deep-gray-and-black-pro-concept-plus-series>: HTTP status code is not handled or not allowed
2026-01-10 20:27:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-aluminum-sign-danger-this-equipment-starts-automatically>: HTTP status code is not handled or not allowed
2026-01-10 20:27:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gtek-maxicool-ultra-light-weight-blue-foam-nitrile-dip-white-s>: HTTP status code is not handled or not allowed
2026-01-10 20:27:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bl0400-lifting-magnet-400-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:27:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-1-power-bit-x-2-3-4-extra-hard-s2-modified-steel-black-manganese-phosphate>: HTTP status code is not handled or not allowed
2026-01-10 20:27:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-vinyl-sign-caution-wheels-must-be-chocked-before-loading-unloading-1>: HTTP status code is not handled or not allowed
2026-01-10 20:27:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m3713t-15-hp-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-m3534-33-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esp-kit-1-pair-esp-glove-1-pair-goat-protector-class-00-size-11>: HTTP status code is not handled or not allowed
2026-01-10 20:27:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polywoven-airbag-48-x-48-level-1-aar-certified>: HTTP status code is not handled or not allowed
2026-01-10 20:27:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-zdvscp3770t-7-5-hp-6200-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-3-tier-wire-shelving-starter-unit-42w-x-21d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:27:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-tamper-3-16-power-bit-x-2-s2-modified-steel-gunmetal-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:27:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-spherical-washer-set-4-1-2-o-d-7-8-thick-carbon-steel-usa-black-oxide-sp-14>: HTTP status code is not handled or not allowed
2026-01-10 20:27:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-2-tier-wire-shelving-starter-unit-36w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:27:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phillips-acr-2-power-bit-x-6-s2-modified-steel-gunmetal-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:27:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xapsphalt-car-stop-speed-bump-speed-hump-installation-hardware-asphalt-installation>: HTTP status code is not handled or not allowed
2026-01-10 20:27:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-label-dispenser-for-up-to-2w-labels-table-or-wall-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:27:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-2-tier-wire-shelving-add-on-unit-42w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:27:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torx-174-15-power-bit-x-2-gunmetal-bronze-s2-modified-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:27:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/400-b-20r-20-lb-recycled-rubber-base-for-gemstone-vertical-panel-barricade-parking-signs-black>: HTTP status code is not handled or not allowed
2026-01-10 20:27:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-zdvsncp3581t-1te-hp-6000-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-3-tier-wire-shelving-add-on-unit-60w-x-14d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:27:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zurn-9-x-9-square-floor-drain-wscrews-nickel>: HTTP status code is not handled or not allowed
2026-01-10 20:27:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-5-32-insert-bit-x-1-gunmetal-bronze-s2-modified-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:27:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phillips-1-insert-bit-x-1-gunmetal-bronze-s2-modified-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:27:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-enamel-gloss-white-32-oz-pail-1-case-31000-4>: HTTP status code is not handled or not allowed
2026-01-10 20:27:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-plastic-sign-danger-pesticides-keep-out>: HTTP status code is not handled or not allowed
2026-01-10 20:27:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mh-2d-2448-hdfl-48-w-mobile-bench-cabinets-heavy-duty-drawer-hardboard-top-2-doors>: HTTP status code is not handled or not allowed
2026-01-10 20:27:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-zdvsm4104t-30-hp-5400-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-16-flange-nut-11-16-hex-7-8-flange-dia-1-2-height-carbon-steel-black-oxide-cn-10>: HTTP status code is not handled or not allowed
2026-01-10 20:27:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baldor-motor-vuhl3519-1-hp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:27:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-half-foot-patio-umbrella-olefin-woven-granite-hardwood-pole-grove>: HTTP status code is not handled or not allowed
2026-01-10 20:27:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jat-413-1-4-straight-aluminum-die-grinder>: HTTP status code is not handled or not allowed
2026-01-10 20:27:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spanish-vinyl-sign-peligro-no-pasar>: HTTP status code is not handled or not allowed
2026-01-10 20:27:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-x-20-maroon-ecoprep-epp-chemical-free-stripping-pad-10-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:27:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/watts-filters-20x2-12-softening-cartridge>: HTTP status code is not handled or not allowed
2026-01-10 20:27:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mb3-2448-fl-48-w-mobile-bench-cabinets-center-shelf>: HTTP status code is not handled or not allowed
2026-01-10 20:28:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-3-tier-wire-shelving-starter-unit-48w-x-14d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coat-hangers-chrome-plated-pkg-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:28:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/l-3cg-3-w-l-connector-for-4-6-pipe>: HTTP status code is not handled or not allowed
2026-01-10 20:28:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-5-tier-wire-shelving-add-on-unit-60w-x-14d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standing-height-desk-48-x-24-charcoal-top-black-base>: HTTP status code is not handled or not allowed
2026-01-10 20:28:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-2-tier-wire-shelving-starter-unit-30w-x-14d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r-3cg-10-3-w-r-connector-for-4-6-pipe>: HTTP status code is not handled or not allowed
2026-01-10 20:28:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cam-follower-sealed-hex-head-2-1-4-l-stud-15-w-roller-25-roller-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:28:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/battery-cable-set-with-5-16-ring-terminals-2-awg-3-ft-black-red>: HTTP status code is not handled or not allowed
2026-01-10 20:28:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-vinyl-sign-caution-hazardous-material-storage-area>: HTTP status code is not handled or not allowed
2026-01-10 20:28:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/watts-wound-filter-ff-cartridges-9-34lx4-12od-1-micron>: HTTP status code is not handled or not allowed
2026-01-10 20:28:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-vise-and-4-lb-hammer-combo-6-5>: HTTP status code is not handled or not allowed
2026-01-10 20:28:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-battery-cable-with-5-16-ring-terminals-4-awg-5-ft-black>: HTTP status code is not handled or not allowed
2026-01-10 20:28:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-truck-esd-21w-x-42l-x-60h-polyurethane-4-swivel-2-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:28:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spanish-vinyl-sign-aviso-mantenga-esta-puerta-cerrada>: HTTP status code is not handled or not allowed
2026-01-10 20:28:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19743 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:28:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-cart-esd-2-shelf-24w-x-72l-polyurethane-4-swivel-2-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:28:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-174-luxury-foam-hand-soap-1250ml-refill-6-refills-case>: HTTP status code is not handled or not allowed
2026-01-10 20:28:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spanish-aluminum-sign-peligro-blank>: HTTP status code is not handled or not allowed
2026-01-10 20:28:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-battery-cable-with-5-16-ring-terminals-2-awg-2-ft-red>: HTTP status code is not handled or not allowed
2026-01-10 20:28:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/summit-full-sized-beverage-merchandiser-wautomatic-defrost-slim-width-ss-cabinet>: HTTP status code is not handled or not allowed
2026-01-10 20:28:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-174-reach-refrigerator-2-door-54-wx32-2-dx82-5-h-47-cu>: HTTP status code is not handled or not allowed
2026-01-10 20:28:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-shelf-cart-esd-2-shelf-24w-x-54l-polyurethane-4-swivel-2-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:28:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexbollard-52h-x-7-14w-w99h-signpost-asphalt-redwhite-xl-b528-a-redwhite>: HTTP status code is not handled or not allowed
2026-01-10 20:28:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-battery-cable-with-5-16-ring-terminals-11-0-awg-12-ft-black>: HTTP status code is not handled or not allowed
2026-01-10 20:28:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexbollard-52h-adhesive-anchoring-to-concrete-blackwhite-b52-d-blackwhite>: HTTP status code is not handled or not allowed
2026-01-10 20:28:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leviton-80414-gy-quickport-decora-multimedia-blank-insert-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:28:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-infinity-ventilated-steel-locker-double-tier-3-wide-12x18x36-assembled-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:28:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rare-earth-grate-magnet-316-ss-18-round>: HTTP status code is not handled or not allowed
2026-01-10 20:28:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-heavy-duty-mobile-work-platform-handrails-36-x-48-platform>: HTTP status code is not handled or not allowed
2026-01-10 20:28:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ch-270288-8-inside-of-pipe-gripper-plug-17-psi-40ft>: HTTP status code is not handled or not allowed
2026-01-10 20:28:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/battery-cable-set-with-5-16-ring-terminals-4-0-awg-3-ft-black-red>: HTTP status code is not handled or not allowed
2026-01-10 20:28:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-esd-24w-x-72l-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-aluminum-dock-board-with-welded-aluminum-curb-60x30-15-000-lb-capacity-987005>: HTTP status code is not handled or not allowed
2026-01-10 20:28:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/danger-sign-14x10-rigid-plastic-flammable-material-keep-fire-away>: HTTP status code is not handled or not allowed
2026-01-10 20:28:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cover-your-cough-compliance-kit-8-1-4-w-x-4-d-x-5-5-8-h-transparent>: HTTP status code is not handled or not allowed
2026-01-10 20:28:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ch-273968-air-max-pro-hv-test-pump>: HTTP status code is not handled or not allowed
2026-01-10 20:28:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cover-your-cough-compliance-kit-8-3-8-w-x-4-7-16-d-x-16-3-8-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:28:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-battery-cable-with-5-16-ring-terminals-4-0-awg-2-ft-red>: HTTP status code is not handled or not allowed
2026-01-10 20:28:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/danger-sign-14x10-vinyl-no-smoking-matches-or-open-flames>: HTTP status code is not handled or not allowed
2026-01-10 20:28:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-14w-x-60l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honeywell-universal-120208240-vac-transformer-9-lead-wires-metal-end-bells>: HTTP status code is not handled or not allowed
2026-01-10 20:28:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/danger-sign-10x7-rigid-plastic-electrical-hazard>: HTTP status code is not handled or not allowed
2026-01-10 20:28:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oty-30755-purple-primer-4-oz-nsf-listed>: HTTP status code is not handled or not allowed
2026-01-10 20:28:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42774b-condition-disc-hook-and-loop-4-1-2-aluminum-oxide-medium>: HTTP status code is not handled or not allowed
2026-01-10 20:28:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11115-qc-disc-type-s-2-aluminum-oxide-medium>: HTTP status code is not handled or not allowed
2026-01-10 20:28:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-shelf-cart-esd-3-shelf-24w-x-72l-polyurethane-4-swivel-2-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:28:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11890-cartridge-roll-1-2-x-1-5-x-1-8-aluminum-oxide-medium>: HTTP status code is not handled or not allowed
2026-01-10 20:28:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/recessed-vertical-1250-series-3-door-mailbox-anodized-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:28:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/notice-sign-10x7-rigid-plastic-keep-door-closed>: HTTP status code is not handled or not allowed
2026-01-10 20:28:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honeywell-limit-control-fixed-165-range-3-insertion>: HTTP status code is not handled or not allowed
2026-01-10 20:28:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-shelf-truck-esd-3-shelf-21w-x-72l-x-40h-polyurethane-4-swivel-2-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:28:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/notice-sign-14x10-rigid-plastic-wash-hands-before-returning-to-work>: HTTP status code is not handled or not allowed
2026-01-10 20:28:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40440-satin-disc-wheel-1-8-mandrel-1-1-2-aluminum-oxide-fine>: HTTP status code is not handled or not allowed
2026-01-10 20:28:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-no-parking-1-8-thick-polytough-plastic-white>: HTTP status code is not handled or not allowed
2026-01-10 20:28:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hc-25410-roof-and-flashing-sealant-gallon>: HTTP status code is not handled or not allowed
2026-01-10 20:28:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-stage-air-compressor-w-silencer-7-5-hp-80-gal-1-phase-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:28:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oty-81130-6-round-cover-and-ring-brass>: HTTP status code is not handled or not allowed
2026-01-10 20:28:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caution-sign-14x10-aluminum-hot>: HTTP status code is not handled or not allowed
2026-01-10 20:28:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1000v-insulated-adjustable-wrench-8-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:28:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-esd-24w-x-72l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-panel-display-tower-6-ft-5-inch-fabric-color-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:28:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-1-4-inch-x-8-3-4-inch-x-12-inch-white-corrugated-boxes>: HTTP status code is not handled or not allowed
2026-01-10 20:28:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r8860-16-braided-ss-lav-snk-sup-3-8comp-x-1-2fip-x-16>: HTTP status code is not handled or not allowed
2026-01-10 20:28:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freestanding-office-partition-panel-with-partial-window-36-14-w-x-60-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:28:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-esd-21w-x-72l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hacksaw-replacement-blades-24-tpi-12-inch-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:28:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-pad-steerable-knee-walker-with-basket-31-40-handle-height-adult-size>: HTTP status code is not handled or not allowed
2026-01-10 20:28:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/82457-psa-disc-5-dia-120-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 20:28:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/82456-psa-disc-5-dia-100-grit-aluminum-oxide>: HTTP status code is not handled or not allowed
2026-01-10 20:28:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mw-48246-ss-beverage-merchandiser-48w-x-24d-x-6h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-30w-x-48l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/training-panel-leg-folding-table-18in-x-96in-walnut-top>: HTTP status code is not handled or not allowed
2026-01-10 20:28:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/individual-character-stencil-12-number-2>: HTTP status code is not handled or not allowed
2026-01-10 20:28:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-truck-esd-36w-x-36l-x-60h-polyurethane-4-swivel-2-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:28:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/speakman-sc-5811-rcp-commander-service-sink-faucet-cross-handles>: HTTP status code is not handled or not allowed
2026-01-10 20:28:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-24w-x-48l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-non-electric-office-partition-panel-with-raceway-48-14-w-x-77-12-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:28:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-18w-x-48l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/individual-character-stencil-12-letter-e>: HTTP status code is not handled or not allowed
2026-01-10 20:28:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-18w-x-36l-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-plastic-garbage-can-with-lid-20-gal-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:28:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mw-50506-sf-display-base-pallet-spot-merchandiser-50w-x-50d-x-6h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:28:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fda-silicone-tubing-116id-x-18od-x-100-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:28:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-4-tier-esd-18w-x-72l-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rechargeable-battery-for-x-talker-series-white-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:28:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-3-tier-esd-24w-x-30l-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/be-1600wawy-16-high-density-polyethylene-surface-cleaner>: HTTP status code is not handled or not allowed
2026-01-10 20:28:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/individual-character-stencil-24-number-2>: HTTP status code is not handled or not allowed
2026-01-10 20:28:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-high-performance-v2100-system-equip-aero-john-deere-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:28:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-freestanding-office-partition-panel-wpartial-window-60-14-w-x-61-12-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:28:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gold-fibre-retro-pad-20008r-8-12-x-11-34-antique-ivory-70-sheetspad-1-padpack>: HTTP status code is not handled or not allowed
2026-01-10 20:28:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-o-ring-2-5mm-wide-7mm-id-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:28:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x1-1-4-bugle-head-drywall-screws-0820CQG>: HTTP status code is not handled or not allowed
2026-01-10 20:28:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-3-tier-esd-21w-x-72l-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:28:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-ole-com-cv740-sys-100-voc-dtm-alkyd-ena-rust-prev-mnt-pnt-sfty-rd>: HTTP status code is not handled or not allowed
2026-01-10 20:28:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-office-partition-panel-48-14-w-x-76-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:28:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neenah-paper-classic-laid-stationery-writing-paper-6511-8-12-x-11-avon-white-500-sheetsream>: HTTP status code is not handled or not allowed
2026-01-10 20:28:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-office-partition-panel-wpartial-window-raceway-60-14-w-x-47-12-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:29:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelving-starter-unit-5-tier-esd-36w-x-48l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:29:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t200-head-harness-tychem2000-shoulder-length-face-seal-hood-hx5-papr>: HTTP status code is not handled or not allowed
2026-01-10 20:29:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-sierra-perform-metalmax-0-voc-dtm-acryl-ena-semi-gls-tnt-ba>: HTTP status code is not handled or not allowed
2026-01-10 20:29:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/individual-character-stencil-4-letter-set-a-z>: HTTP status code is not handled or not allowed
2026-01-10 20:29:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-office-partition-panel-wpartial-window-pass-thru-cable-48-14wx65-12h-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:29:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-flange-sign-emergency-shut-off>: HTTP status code is not handled or not allowed
2026-01-10 20:29:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-18x1-indent-hex-washer-head-thread-cutting-screws-type-1-31161W>: HTTP status code is not handled or not allowed
2026-01-10 20:29:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-high-perform-v2100-rust-prevent-enamel-aero-chestnut-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:29:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-detectable-silicone-o-ring-dash-226-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:29:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roaring-spring-usda-cert-bio-preferred-legal-pad-24326-8-12-x-11-34-white-40-shtspad-12pk>: HTTP status code is not handled or not allowed
2026-01-10 20:29:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-companion-marking-wand>: HTTP status code is not handled or not allowed
2026-01-10 20:29:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conductive-silicone-o-ring-dash-228-pack-of-5>: HTTP status code is not handled or not allowed
2026-01-10 20:29:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clearance-bar-4-d-x-96-l-white-bar-no-tapes>: HTTP status code is not handled or not allowed
2026-01-10 20:29:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-5600-sys-100-voc-acryl-urethane-flr-paint-silver-gry-5-gal>: HTTP status code is not handled or not allowed
2026-01-10 20:29:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-safety-sign-fire-alarm-vinyl-3>: HTTP status code is not handled or not allowed
2026-01-10 20:29:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19841 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:29:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-24x1-1-2-round-head-machine-screws-1024MCR>: HTTP status code is not handled or not allowed
2026-01-10 20:29:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/push-spreader-50-lbs-20-inch-l-x-17-inch-w-x-34-inch-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:29:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-32x1-1-2-pan-head-machine-screws-0824MPPB>: HTTP status code is not handled or not allowed
2026-01-10 20:29:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rust-oleum-9100-system-340voc-dtm-epoxy-mastic-safety-green>: HTTP status code is not handled or not allowed
2026-01-10 20:29:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-fit-front-mount-dethatcher-black>: HTTP status code is not handled or not allowed
2026-01-10 20:29:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rk-05-small-holder-rack-with-tilt-adjustment>: HTTP status code is not handled or not allowed
2026-01-10 20:29:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-partition-tan-36-1-4-x-60>: HTTP status code is not handled or not allowed
2026-01-10 20:29:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-safety-sign-arrow-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 20:29:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tun2014-tire-tube-replacement-size-27-x-85-15-tr15>: HTTP status code is not handled or not allowed
2026-01-10 20:29:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/entrance-mat-3-8-thick-4-l-x-6-w-black-smooth-backing>: HTTP status code is not handled or not allowed
2026-01-10 20:29:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buna-n-o-ring-6mm-wide-10mm-id-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 20:29:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/entrance-mat-3-8-thick-2-l-x-3-w-gray-cleated-backing>: HTTP status code is not handled or not allowed
2026-01-10 20:29:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-bollard-stainless-steel-36-in-h-x-4-1-2-in-diameter>: HTTP status code is not handled or not allowed
2026-01-10 20:29:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/entrance-mat-3-8-thick-3-l-x-5-w-gray-smooth-backing>: HTTP status code is not handled or not allowed
2026-01-10 20:29:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/asb1089-lawn-and-garden-tire-assembly-size-20-x-800-8>: HTTP status code is not handled or not allowed
2026-01-10 20:29:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/viton-o-ring-2mm-wide-25mm-id-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:29:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-panel-shipping-crate-with-lid-pallet-84-x-48-x-48-od>: HTTP status code is not handled or not allowed
2026-01-10 20:29:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roxbury-full-size-tufted-upholstered-platform-bed-in-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:29:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-o-ring-dash-227-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:29:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-lockout-tags-this-energy-source-has-been-locked-out>: HTTP status code is not handled or not allowed
2026-01-10 20:29:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-lockout-station-with-contents>: HTTP status code is not handled or not allowed
2026-01-10 20:29:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8x2-modified-truss-head-self-drilling-screws-0832KPM>: HTTP status code is not handled or not allowed
2026-01-10 20:29:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dustless-174-wunderbag-153-prefilter-13141-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:29:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-tag-center>: HTTP status code is not handled or not allowed
2026-01-10 20:29:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tribeca-full-size-tufted-upholstered-platform-bed-in-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:29:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/441-3-4-brass-valve-extension>: HTTP status code is not handled or not allowed
2026-01-10 20:29:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-582e-precision-inflator-gauge-digital-0-160-psi-w-kwik-grip-chuck-36-hose>: HTTP status code is not handled or not allowed
2026-01-10 20:29:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-530-compact-inflator-gauge-w-digital-gauge-and-dual-head-chuck>: HTTP status code is not handled or not allowed
2026-01-10 20:29:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-paper-filter-bag-for-cat-c06v-wet-dry-vacuum-641758>: HTTP status code is not handled or not allowed
2026-01-10 20:29:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/17-rubber-slush-boots-mens-black-size-1719-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:29:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-inch-snow-shuffel>: HTTP status code is not handled or not allowed
2026-01-10 20:29:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fda-silicone-tubing-14id-x-12od-x-100-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:29:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-platform-bed-frame-with-steel-slat-support-14-h-queen-size>: HTTP status code is not handled or not allowed
2026-01-10 20:29:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-o-ring-1-5mm-wide-8mm-id-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:29:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-ton-aluminum-jack-stand-and-service-jack-pack-6603asjpk>: HTTP status code is not handled or not allowed
2026-01-10 20:29:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fda-silicone-tubing-1id-x-1-14od-x-10-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:29:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-ton-short-bottle-jack-4412s>: HTTP status code is not handled or not allowed
2026-01-10 20:29:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comfortable-sleep-king-12-foam-pocket-spring-mattress-3-gel-memory-foam-topper>: HTTP status code is not handled or not allowed
2026-01-10 20:29:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-composite-air-impact-wrench-6-ext-anvil-1-drive-2200-max-torque>: HTTP status code is not handled or not allowed
2026-01-10 20:29:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/resilient-anti-slip-tape-black-4-w>: HTTP status code is not handled or not allowed
2026-01-10 20:29:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-activated-carbon-filter-233-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:29:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dupont-153-tyvek-174-400-boot-covers-18-h-gray-100-case>: HTTP status code is not handled or not allowed
2026-01-10 20:29:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-air-compressor-2475n75-premium-200v-3ph-60hz>: HTTP status code is not handled or not allowed
2026-01-10 20:29:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10x3-phillips-bugle-head-exterior-wood-deck-screws-18-8-stainless-steel-1048DPG188>: HTTP status code is not handled or not allowed
2026-01-10 20:29:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20x5-8-pan-head-machine-screws-1410MSPN>: HTTP status code is not handled or not allowed
2026-01-10 20:29:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-25-11111-30-psi-14-lm-polished-brass>: HTTP status code is not handled or not allowed
2026-01-10 20:29:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-16-20x2-hex-tap-bolts-grade-8-4432BHT8>: HTTP status code is not handled or not allowed
2026-01-10 20:29:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-ink-pad-for-economy-self-inking-dater-black>: HTTP status code is not handled or not allowed
2026-01-10 20:29:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ingersoll-rand-dust-filter-21-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:29:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-25-11112-30inhg30psi-14-cbm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:29:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ventless-dual-fuel-gas-stove-25000-btu-t-stat-control-black>: HTTP status code is not handled or not allowed
2026-01-10 20:29:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-25-11112-60-psikpa-14-cbm-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:29:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-25-11110-200-psikpa-14-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:29:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rigid-temporary-raised-pavement-marker-w-adhesive-1way-white>: HTTP status code is not handled or not allowed
2026-01-10 20:29:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-24x1-4-pan-head-machine-screws-1004MSPN>: HTTP status code is not handled or not allowed
2026-01-10 20:29:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-inking-heavy-duty-stamps>: HTTP status code is not handled or not allowed
2026-01-10 20:29:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-fuel-ventless-gas-fireplace-insert-arched-door-15000-btu-t-stat-control>: HTTP status code is not handled or not allowed
2026-01-10 20:29:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/professional-numberer-self-inking-type-size-2-eight-digits-black>: HTTP status code is not handled or not allowed
2026-01-10 20:29:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xtube-78-sign-post-w-base-white>: HTTP status code is not handled or not allowed
2026-01-10 20:29:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-drum-lifter-positioner-63-12v-dc-lift-24v-rotation-clamp-cradle-987027>: HTTP status code is not handled or not allowed
2026-01-10 20:29:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cantilever-shelving-72-wx24-dx72-h>: HTTP status code is not handled or not allowed
2026-01-10 20:29:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proguard-intercept-micro-filter-bag-15-20-gallon-3-pack-107180>: HTTP status code is not handled or not allowed
2026-01-10 20:29:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lux-sspp2b-o5x-ss-wick-b-eye-polo-org-5x>: HTTP status code is not handled or not allowed
2026-01-10 20:29:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lux-lspp2b-oxl-ls-wick-b-eye-polo-org-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:29:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neoprene-foam-with-acrylic-adhesive-132-thick-x-12w-x-10l>: HTTP status code is not handled or not allowed
2026-01-10 20:29:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lux-sspp2b-o4x-ss-wick-b-eye-polo-org-4x>: HTTP status code is not handled or not allowed
2026-01-10 20:29:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/800-lumen-rechargeable-led-work-light>: HTTP status code is not handled or not allowed
2026-01-10 20:29:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neoprene-foam-with-acrylic-adhesive-14-thick-x-1-12w-x-10l>: HTTP status code is not handled or not allowed
2026-01-10 20:29:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-20x3-4x1-wing-nuts-1412NWA>: HTTP status code is not handled or not allowed
2026-01-10 20:29:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermoformed-plastic-parts-tray-14-1-2-x-9-x-2-6-compartments-black-269962>: HTTP status code is not handled or not allowed
2026-01-10 20:29:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-25-11110-30inhg30psikpa-14-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:29:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-danger-vinyl-high-voltage-keep-out>: HTTP status code is not handled or not allowed
2026-01-10 20:29:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comfort-grip-retractable-ballpoint-pen-medium-1mm-blue-ink-barrel-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:29:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-danger-rigid-plastic-hazardous-chemicals>: HTTP status code is not handled or not allowed
2026-01-10 20:29:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dri-eaz-hepa-700-air-scrubber>: HTTP status code is not handled or not allowed
2026-01-10 20:29:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/energize-x-mechanical-pencil-0-7-mm-hb-2-5-black-lead-black-barrel-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:29:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-drop-in-anchor-284930>: HTTP status code is not handled or not allowed
2026-01-10 20:29:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-2-11110-3000-psi-14-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:29:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-32x3-pan-head-machine-screws-0648MPP>: HTTP status code is not handled or not allowed
2026-01-10 20:29:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-16x3-4-hex-tap-bolts-grade-5-3712BHT5>: HTTP status code is not handled or not allowed
2026-01-10 20:30:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-25-11110-30inhg60psi-14-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:30:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-25-11110-30-inhg100-psi-14-lm-plastic>: HTTP status code is not handled or not allowed
2026-01-10 20:30:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-eyewash-drench-hose-unit-w-hand-truck-15-gal>: HTTP status code is not handled or not allowed
2026-01-10 20:30:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-48-flat-top-pallet-2-way-entry>: HTTP status code is not handled or not allowed
2026-01-10 20:30:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grade-f1-felt-sheet-18-thick-x-12w-x-12l>: HTTP status code is not handled or not allowed
2026-01-10 20:30:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4x1-1-4-fender-washers-1420WFG>: HTTP status code is not handled or not allowed
2026-01-10 20:30:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pilot-light-operator-22mm-red>: HTTP status code is not handled or not allowed
2026-01-10 20:30:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hirsh-industries-8000-series-receding-drawer-front-lateral-file-4-drawer-putty>: HTTP status code is not handled or not allowed
2026-01-10 20:30:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-matrix-printer-address-labels-1-across-1-15-16-x-4-white-5000-box-4022>: HTTP status code is not handled or not allowed
2026-01-10 20:30:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hirsh-industries-1000-series-lateral-file-30in-wide-2-drawer-putty>: HTTP status code is not handled or not allowed
2026-01-10 20:30:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10x1-2-round-head-type-u-drive-screws-1008U>: HTTP status code is not handled or not allowed
2026-01-10 20:30:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-machine-screw-washers-14WM188>: HTTP status code is not handled or not allowed
2026-01-10 20:30:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hirsh-industries-25in-deep-vertical-file-cabinet-4-drawer-letter-size-black>: HTTP status code is not handled or not allowed
2026-01-10 20:30:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/illuminated-push-button-operator-22mm-white>: HTTP status code is not handled or not allowed
2026-01-10 20:30:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stick-ballpoint-counter-pen-medium-1mm-black-ink-black-barrel>: HTTP status code is not handled or not allowed
2026-01-10 20:30:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 19935 pages (at 94 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:30:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10x1-2-round-spacers-370810RS303>: HTTP status code is not handled or not allowed
2026-01-10 20:30:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-pre-sharpened-woodcase-pencil-hb-2-black-lead-yellow-barrel-72-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:30:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-8-18-nylon-insert-hex-lock-nut-63NS8>: HTTP status code is not handled or not allowed
2026-01-10 20:30:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-square-trash-can-waste-lid-36-gal-black>: HTTP status code is not handled or not allowed
2026-01-10 20:30:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6003nr-open-wsnap-ring-17mm-bore-35mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:30:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/folding-bed-wedge-10>: HTTP status code is not handled or not allowed
2026-01-10 20:30:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-heavy-wieght-sorbent-pads-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:30:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-tape-1-x100-1>: HTTP status code is not handled or not allowed
2026-01-10 20:30:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-truck-tire-inflator-gauge-10-to-160-psi-7ft-hose-550>: HTTP status code is not handled or not allowed
2026-01-10 20:30:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4x1-1-4-split-drive-anchors-1420ADSPR>: HTTP status code is not handled or not allowed
2026-01-10 20:30:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/print-to-the-edge-easy-peel-labels-with-trueblock-1-1-2-x-1-1-2-white-600-pk-22805>: HTTP status code is not handled or not allowed
2026-01-10 20:30:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-six-drawer-anesthesia-cart-with-md30-ans3-accessory-package-red>: HTTP status code is not handled or not allowed
2026-01-10 20:30:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-drum-lift-tilter-for-55-gallon-drums-800-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-visibility-laser-labels-2-x-4-assorted-neons-150-pack-5978>: HTTP status code is not handled or not allowed
2026-01-10 20:30:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelving-add-on-a24368b-36w-x-24d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:30:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-sign-rigid-plastic-fire-door-do-not-block>: HTTP status code is not handled or not allowed
2026-01-10 20:30:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-40x1-4-hex-jackscrews-100404JM>: HTTP status code is not handled or not allowed
2026-01-10 20:30:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ecofriendly-labels-2-3-x-3-7-16-white-1500-pack-45366>: HTTP status code is not handled or not allowed
2026-01-10 20:30:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rk-06a-adjustable-precision-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:30:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n3c-r-edge-series-light-diffuser-focuser>: HTTP status code is not handled or not allowed
2026-01-10 20:30:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rk-06-pl-extension-pole-for-rk-06a-stand>: HTTP status code is not handled or not allowed
2026-01-10 20:30:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6210zznr-double-shielded-wsnap-ring-50mm-bore-90mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:30:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glow-sign-vinyl-case-of-fire-do-not-use-elevator>: HTTP status code is not handled or not allowed
2026-01-10 20:30:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tpi-24-high-velocity-air-circulator-w-yoke-mount-direct-drive-1-2-hp-277v-1-ph>: HTTP status code is not handled or not allowed
2026-01-10 20:30:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14x1-round-spacers-501614RSN>: HTTP status code is not handled or not allowed
2026-01-10 20:30:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brk5-fuse-pro-5-amp-tester-with-light>: HTTP status code is not handled or not allowed
2026-01-10 20:30:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/automatic-tensioning-rewinder-for-up-to-8-x-12-dia-3-core-rolls-right-side-of-printer-zcat-3-220-l-r>: HTTP status code is not handled or not allowed
2026-01-10 20:30:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-12-bar-tong-lifter-yellow-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-dia-x-12-working-length-j-hook-style-a>: HTTP status code is not handled or not allowed
2026-01-10 20:30:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-clearview-stock-truck-48x30-4-adjustable-2-fixed-shelves>: HTTP status code is not handled or not allowed
2026-01-10 20:30:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-bottle-rack-holds-bottle-diameter-5-75-and-under-white>: HTTP status code is not handled or not allowed
2026-01-10 20:30:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6010-open-50mm-bore-80mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:30:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-line-do-not-cross-barricade-tape-polyethylene-yellow-tapeblack-print-3-x-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:30:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-emergency-crash-cart-6-drawers-36-3-4-w-x-22-l-x-43-3-4-h-hammertone-red>: HTTP status code is not handled or not allowed
2026-01-10 20:30:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-dishmate-153-manual-dishwashing-liquid-free-clear-25-oz-bottle-6-pack-pl9721-6>: HTTP status code is not handled or not allowed
2026-01-10 20:30:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-daily-whiteboard-cleaner-32-oz-trigger-spray-6-pack-pl9869-6>: HTTP status code is not handled or not allowed
2026-01-10 20:30:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/upright-freezer-4-2-cu-ft-white-duf480we>: HTTP status code is not handled or not allowed
2026-01-10 20:30:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-visibility-full-brimmed-ranger-hat-polyester-meshoxford-orange-lxl>: HTTP status code is not handled or not allowed
2026-01-10 20:30:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/catheter-cart-with-basket-chrome-2-casters-w-brakes-24l-x-48w-x-68h>: HTTP status code is not handled or not allowed
2026-01-10 20:30:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-x-12-working-length-j-hook-style-b>: HTTP status code is not handled or not allowed
2026-01-10 20:30:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-short-emergency-crash-cart-md30-emg1-std-width-4-drawers-breakaway-lock-purple>: HTTP status code is not handled or not allowed
2026-01-10 20:30:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/92-pocket-rotary-literature-rack-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:30:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quad-column-medical-storage-cabinet-glass-doors-82-1-8-wx30-1-4-dx77-3-4-h-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:30:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-emergency-crash-cart-6-drawers-36-3-4-w-x-26-l-x-43-h-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:30:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vp300-main-sack-filter-1471432500>: HTTP status code is not handled or not allowed
2026-01-10 20:30:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-shopping-basket-28-liter-with-nylon-handle-206-28l-drk-green>: HTTP status code is not handled or not allowed
2026-01-10 20:30:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/barrel-bucket-lifter-yellow-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/p-touch-easy-portable-label-maker-pth110-3-fonts-white-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:30:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-drawer-parts-cabinet-10126-20w-x-6-3-8d-x-10-1-4h-black-26-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:30:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-series-narrow-medical-cart-6-drawers-e-lock-24-3-4-wx22-lx43-3-4-h-hammertone-red>: HTTP status code is not handled or not allowed
2026-01-10 20:30:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s373pt-ansi-class-e-lightweight-rain-pants-hi-vis-lime-4x-61515>: HTTP status code is not handled or not allowed
2026-01-10 20:30:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-placard-flammable-solid-4-2>: HTTP status code is not handled or not allowed
2026-01-10 20:30:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s163-ansi-class-3-long-raincoat-hi-vis-orange-lg-62036>: HTTP status code is not handled or not allowed
2026-01-10 20:30:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62250-s363pb-class-2-zip-up-mesh-economy-vest-w-pockets-hi-vis-lime-w-black-bottom-m>: HTTP status code is not handled or not allowed
2026-01-10 20:30:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ibc-tote-lift-beam-yellow-5000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-premium-light-weight-inspection-gloves-unhemmed-men-97-500-14i>: HTTP status code is not handled or not allowed
2026-01-10 20:30:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-placard-four-digit-3257-1>: HTTP status code is not handled or not allowed
2026-01-10 20:30:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/61335-s762p-non-ansi-vest-tricot-hook-loop-closure-hi-vis-pink-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:30:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-72-economy-h-beam-adjustable-length-yellow-78-l-x-40-w-x-36-h-200lbs-2000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wiredog-eyewear-retainers-15750>: HTTP status code is not handled or not allowed
2026-01-10 20:30:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-duty-nylon-glove-polyurethane-coated-black-33-b125-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:30:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6308zznr-double-shielded-wsnap-ring-40mm-bore-90mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:30:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/330-volt-start-capacitor-30-36-mfd-30d>: HTTP status code is not handled or not allowed
2026-01-10 20:30:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-isolation-cart-4-drawers-37-1-2-w-x-22-l-x-42-63-100-h-forest-green>: HTTP status code is not handled or not allowed
2026-01-10 20:30:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6015zznr-double-shielded-wsnap-ring-75mm-bore-115mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:30:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6916-open-80mm-bore-110mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:30:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8918bk-class-e-hi-vis-rain-overalls-lime-xl-25015>: HTTP status code is not handled or not allowed
2026-01-10 20:30:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/right-container-lift-12-l-x-6-w-x-8-h-yellow-19000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8388-hi-vis-class-3-2-thermal-jacket-type-r-class-lime-3xl-25537>: HTTP status code is not handled or not allowed
2026-01-10 20:30:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-8-x-6-working-length-j-hook-style-9>: HTTP status code is not handled or not allowed
2026-01-10 20:30:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-feet-x-6-feet-sf-9-93-oz-water-resist-canvas-tarp-olive-drab>: HTTP status code is not handled or not allowed
2026-01-10 20:30:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-only-boom-10-x-5-294-gallon-capacity-4pack>: HTTP status code is not handled or not allowed
2026-01-10 20:30:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-lift-beam-yellow-42-l-x-25-w-x-12-h-346lbs-40000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/61816-s383p-class-2-mesh-vest-hi-vis-lime-contrasting-trim-lg>: HTTP status code is not handled or not allowed
2026-01-10 20:30:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-72-spread-adjustable-lift-yellow-15000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-72-spread-adjustable-lift-yellow-8000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-72-spread-adjustable-lift-yellow-10000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:30:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62384-s252c-class-2-mesh-solid-surveyor-vest-hi-vis-lime-sm>: HTTP status code is not handled or not allowed
2026-01-10 20:30:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-series-lt-weight-emergency-cart-6-drawers-key-lock-36-3-4-wx22-lx40-1-2-h-hammertone-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:30:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-placard-blasting-agent-d1-1>: HTTP status code is not handled or not allowed
2026-01-10 20:30:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/trex-6300tc-one-piece-ice-traction-device-w-tungsten-carbide-studs-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:31:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dot-placard-four-digit-1203-2>: HTTP status code is not handled or not allowed
2026-01-10 20:31:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/limited-hose-for-jkl-115s-and-jkl-240s-models-96>: HTTP status code is not handled or not allowed
2026-01-10 20:31:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-radial-ball-bearing-6226zz-double-shielded-130mm-bore-230mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:31:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-dia-x-9-working-length-j-hook-style-a>: HTTP status code is not handled or not allowed
2026-01-10 20:31:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-910-half-finger-impact-gloves-wrist-support-black-xl-17712>: HTTP status code is not handled or not allowed
2026-01-10 20:31:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kute-44-inch-brushed-satin-brass-with-matte-white-blades>: HTTP status code is not handled or not allowed
2026-01-10 20:31:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cleanmax-zoom-paper-vacuum-bag-for-zm-200-zm-400-zm-600-jan-cmzoom-23>: HTTP status code is not handled or not allowed
2026-01-10 20:31:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sw6guuaj-38-id-clearance-adjustable-type-linear-bearing-wresin-retainer-seals-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:31:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-diamond-series-countertop-manual-defrost-freezer-right-hinged-door-1-7-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:31:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/disposable-earbuds-with-silicone-tips-black>: HTTP status code is not handled or not allowed
2026-01-10 20:31:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-series-lightweight-aluminium-crash-cart-5-drawers-30-w-x-22-l-x-37-1-4-h-brushed-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:31:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/special-on-tripper-for-7000-1800-series>: HTTP status code is not handled or not allowed
2026-01-10 20:31:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-twin-hoist-lift-beam-yellow-10000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:31:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onpak-ultrasonic-dot-line-sealer-100v-240v>: HTTP status code is not handled or not allowed
2026-01-10 20:31:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-bleachers-3-row-15-w-2>: HTTP status code is not handled or not allowed
2026-01-10 20:31:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-emergency-crash-cart-6-drawers-36-3-4-w-x-22-l-x-43-h-taupe>: HTTP status code is not handled or not allowed
2026-01-10 20:31:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/markerboard-activity-table-24in-x-48in-rectangle-standard-adjustable-height>: HTTP status code is not handled or not allowed
2026-01-10 20:31:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20033 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:31:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-series-aluminium-isolation-cart-6-drawers-30-w-x-22-l-x-43-3-4-h-hammertone-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:31:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-2-shelf-container-rack-bk183052n-30w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:31:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-series-aluminium-medical-cart-tall-height-36-3-4-w-x-22-d-x-43-3-4-h-purple>: HTTP status code is not handled or not allowed
2026-01-10 20:31:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelf-platform-p1824b-24w-x-18d>: HTTP status code is not handled or not allowed
2026-01-10 20:31:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/strobe-light-male-pipe-mount-120vac-green-lp3m-120g>: HTTP status code is not handled or not allowed
2026-01-10 20:31:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelon-3-shelf-container-rack-bk18245n-24w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:31:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a161608lp-wall-mount-type-1213-encl-1600x1600x800-steelpaint>: HTTP status code is not handled or not allowed
2026-01-10 20:31:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cmfk-mounting-foot-kit-qty-4-fits-concept-enc-steelzinc>: HTTP status code is not handled or not allowed
2026-01-10 20:31:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-isolation-cart-4-drawers-key-lock-18-w-x-18-l-x-40-3-4-h-light-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:31:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toxic-label-worded-pvc-free-film-500-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:31:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-narrow-emergency-cart-short-height-5-drawers-18-wx18-lx34-1-2-h-hammertone-green>: HTTP status code is not handled or not allowed
2026-01-10 20:31:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/selectone-signal-120vac-4-square-beige-50gc-120bg>: HTTP status code is not handled or not allowed
2026-01-10 20:31:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilco-lu-1-yellow-powder-coated-steel-ladder-safety-post>: HTTP status code is not handled or not allowed
2026-01-10 20:31:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-latch-container-with-lid-21-lx15-7-8-x7-3-4-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:31:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1000-drylin-t-hard-anodized-aluminum-rail-size-20>: HTTP status code is not handled or not allowed
2026-01-10 20:31:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lwc252015-inline-window-door-encl-type-12-250x200x150mm-steelltgray>: HTTP status code is not handled or not allowed
2026-01-10 20:31:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/q13813pcecc-qline-j-box-clear-screw-cover-type-4x-125x75x124mm-polycarb>: HTTP status code is not handled or not allowed
2026-01-10 20:31:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pestle-cell-strainer-individually-wrapped-sterile-50-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:31:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heat-resistant-hose-414813>: HTTP status code is not handled or not allowed
2026-01-10 20:31:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-x-1-2-iglide-g300-polymer-sleeve-bearing>: HTTP status code is not handled or not allowed
2026-01-10 20:31:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heat-resistant-hose-414730>: HTTP status code is not handled or not allowed
2026-01-10 20:31:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-shipper-ata-case-919-wheeled-case-42l-x-20w-x-15h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:31:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-emergency-crash-cart-6-drawers-36-3-4-w-x-22-l-x-43-3-4-h-light-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:31:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1000mm-drylin-n-17mm-miniature-guide-rail>: HTTP status code is not handled or not allowed
2026-01-10 20:31:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-tall-emergency-crash-cart-6-drawers-36-3-4-w-x-22-l-x-43-3-4-h-red>: HTTP status code is not handled or not allowed
2026-01-10 20:31:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stop-the-spread-of-germs-poster-espanol-spanish-vinyl->: HTTP status code is not handled or not allowed
2026-01-10 20:31:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-x-2-11-16-iglide-g300-polymer-sleeve-bearing>: HTTP status code is not handled or not allowed
2026-01-10 20:31:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boss-bridge-47w-x-24d-x-29h-cherry>: HTTP status code is not handled or not allowed
2026-01-10 20:31:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labor-law-poster-north-carolina-spanish>: HTTP status code is not handled or not allowed
2026-01-10 20:31:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uvp-174-double-sided-menu-board-18-w-x-24-h>: HTTP status code is not handled or not allowed
2026-01-10 20:31:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/walk-on-floor-sign-personal-protective-equipment-required>: HTTP status code is not handled or not allowed
2026-01-10 20:31:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bronchoscope-drying-cabinet-wall-mount-key-lock-24-w-x-12-3-4-d-x-48-h-pink>: HTTP status code is not handled or not allowed
2026-01-10 20:31:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipet-storage-rack-4-compartments-abs-plastic-magnetized-white>: HTTP status code is not handled or not allowed
2026-01-10 20:31:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/warm-10-50f-3-window-time-temperature-indicators-100-box>: HTTP status code is not handled or not allowed
2026-01-10 20:31:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cell-lifter-double-end-flat-blade-narrow-blade-sterile-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:31:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/markerboard-activity-table-48in-diameter-circle-juvenile-adjustable-height>: HTTP status code is not handled or not allowed
2026-01-10 20:31:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stop-please-wait-here-8-round>: HTTP status code is not handled or not allowed
2026-01-10 20:31:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/please-wait-here-until-called-forward-6-round>: HTTP status code is not handled or not allowed
2026-01-10 20:31:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyjohn-fleet-portable-restroom-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:31:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/facility-flange-sign-handicapped-symbol>: HTTP status code is not handled or not allowed
2026-01-10 20:31:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyjohn-double-restroom-trailer>: HTTP status code is not handled or not allowed
2026-01-10 20:31:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/please-keep-safe-distance-6-round>: HTTP status code is not handled or not allowed
2026-01-10 20:31:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyjohn-well-care-ada-portable-restroom-evergreen>: HTTP status code is not handled or not allowed
2026-01-10 20:31:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyjohn-bravo-hand-washing-station>: HTTP status code is not handled or not allowed
2026-01-10 20:31:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/engraved-occupancy-sign-use-vacant-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:31:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m-series-narrow-procedure-cart-6-drawers-key-lock-18-w-x-18-l-x-40-3-4-h-forest-green>: HTTP status code is not handled or not allowed
2026-01-10 20:31:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/facility-visi-sign-first-aid>: HTTP status code is not handled or not allowed
2026-01-10 20:31:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triple-column-storage-cabinet-electronic-keypad-lock-60-w-x-28-d-x-81-h-burgundy>: HTTP status code is not handled or not allowed
2026-01-10 20:31:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-tear-drop-backstop-144-l-0-offset>: HTTP status code is not handled or not allowed
2026-01-10 20:31:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/03-768blk-ssh-vertical-panel-black-45-xl-special-store-hours>: HTTP status code is not handled or not allowed
2026-01-10 20:31:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flask-cap-plug-seal-fits-12-5cm-178-25ml-sterile-green-5-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:31:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-24-nsert-for-hard-wood-brass-400-624>: HTTP status code is not handled or not allowed
2026-01-10 20:31:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/octagon-sign-base-60-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:31:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-sign-base-90-lbs-w-u-channel-adaptor-5-u-channel-post>: HTTP status code is not handled or not allowed
2026-01-10 20:31:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15ml-centrifuge-tube-black-bag-sterile-polypropylene-500-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:31:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-shelf-for-boltless-heavy-duty-die-rack-96-w-x-36-d-medium-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:31:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-32-carbon-steel-insert-for-metal-329-008>: HTTP status code is not handled or not allowed
2026-01-10 20:31:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500ml-centrifuge-bottle-pp-non-sterile-2-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:31:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-16-18-insert-for-soft-wood-flush-851618-25>: HTTP status code is not handled or not allowed
2026-01-10 20:31:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50ml-reagent-reservoir-bulk-pack-polystyrene-white-sterile-200-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:31:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-drum-spillpal>: HTTP status code is not handled or not allowed
2026-01-10 20:31:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-drum-in-line-spillpal-w-grate>: HTTP status code is not handled or not allowed
2026-01-10 20:31:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fb-rfb330-motors-and-blowers-1-20-hp-3000-rpm-115v-open>: HTTP status code is not handled or not allowed
2026-01-10 20:31:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/engraved-sign-office-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:31:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-drum-hardcover-spillpallet>: HTTP status code is not handled or not allowed
2026-01-10 20:31:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permaseal-selftapping-concrete-screw-hex-washer-head-blue-14-x-134>: HTTP status code is not handled or not allowed
2026-01-10 20:31:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/selftapping-concrete-screw-hex-head-304-stainless-steel-14-x-114>: HTTP status code is not handled or not allowed
2026-01-10 20:31:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permeable-cell-culture-insert-pkd-in-24-well-plate-hanging-pc-0-4-181-m-24pk>: HTTP status code is not handled or not allowed
2026-01-10 20:31:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/engraved-occupancy-sign-out-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:31:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d0746-oem-motor-for-penn-vent-1-12-hp-1550-1300-rpm-115v-open>: HTTP status code is not handled or not allowed
2026-01-10 20:31:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/engraved-occupancy-sign-alarm-on-off-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:31:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/walk-on-floor-sign-hard-hat-area>: HTTP status code is not handled or not allowed
2026-01-10 20:31:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/train-horn-three-black-abs-trumpet-and-12-volt-solenoid-with-on-board-air-system-having-a-25-gallon-tank-847-858>: HTTP status code is not handled or not allowed
2026-01-10 20:31:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50ml-serological-pipet-individually-wrap-paper-plastic-bag-sterile-polystrene-90-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:31:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suredry-high-volume-16-scope-cabinet-dri-scope-aid-key-lock-44-wx24-dx93-h-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:31:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-acting-hydraulic-cylinder-similar-to-oem-81863>: HTTP status code is not handled or not allowed
2026-01-10 20:31:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerstud-wedge-expansion-anchor-sd1-38-x-5>: HTTP status code is not handled or not allowed
2026-01-10 20:31:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magnification-combination-dial-padlock-7-8-shackle-assorted-pkg-qty-2-1588t>: HTTP status code is not handled or not allowed
2026-01-10 20:31:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m3-05-tapered-ultrasonic-insert-double-vane-dv-m30-th>: HTTP status code is not handled or not allowed
2026-01-10 20:31:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precut-rheumatoid-arthritis-resting-splint-1-8-mini-perforated-medium>: HTTP status code is not handled or not allowed
2026-01-10 20:31:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a20h2408sslp-continuous-hinge-wclamps-type-4x-2000x2400x800in-ss-type-304>: HTTP status code is not handled or not allowed
2026-01-10 20:31:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hazardous-location-blower-hadp9-1-hp-3-ph-explosion-proof-cw-upblast>: HTTP status code is not handled or not allowed
2026-01-10 20:32:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graphic-machine-labels-danger-flammable>: HTTP status code is not handled or not allowed
2026-01-10 20:32:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-40-flush-press-insert-stainless-240-004-cr>: HTTP status code is not handled or not allowed
2026-01-10 20:32:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vertical-paper-dispenser-w-cutter-36-w-x-9-dia-roll-size>: HTTP status code is not handled or not allowed
2026-01-10 20:32:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermoplastic-tape-2-width-x-9-ft-length-blue-1-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:32:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machine-labels-danger-hot>: HTTP status code is not handled or not allowed
2026-01-10 20:32:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ns-antibacterial-splinting-material-24-x-36-x-1-8-non-perforated>: HTTP status code is not handled or not allowed
2026-01-10 20:32:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-18-ga-ta50-locker-with-2-shelves-a-drawer-14-bins-6-moveable-hooks>: HTTP status code is not handled or not allowed
2026-01-10 20:32:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-ga-extra-heavy-duty-4-tier-locker-12-compartments-72-w-x-24-d-x-75-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:32:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k27-control-key-for-w27-cylinder-padlocks>: HTTP status code is not handled or not allowed
2026-01-10 20:32:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-plastic-adjustable-lever-steel-12-13-tapped-362l>: HTTP status code is not handled or not allowed
2026-01-10 20:32:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14-ga-double-tier-ventilated-locker-4-compartments-36-w-x-18-d-x-75-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:32:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machine-labels-danger-moving-machinery-keep-hands-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:32:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vinyl-surface-mounted-corner-guard-90-degrees-corner-1-1-2-inch-wings-4-ft-height-sage-grn-undrilled>: HTTP status code is not handled or not allowed
2026-01-10 20:32:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rainbow-activator-2000-ozone-generator>: HTTP status code is not handled or not allowed
2026-01-10 20:32:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-lad-saf-50-ft-swaged-galvanized-steel-cable-3-8-dia-7-19-strand-6106050>: HTTP status code is not handled or not allowed
2026-01-10 20:32:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tapered-roller-bearing-cup-hm88510>: HTTP status code is not handled or not allowed
2026-01-10 20:32:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20131 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:32:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-18-ga-cabinet-with-3-shelves-and-tall-item-storage-30-w-x-24-d-x-72-h>: HTTP status code is not handled or not allowed
2026-01-10 20:32:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-lad-saf-10-ft-swaged-galvanized-steel-cable-3-8-dia-1-7-strand-6104010>: HTTP status code is not handled or not allowed
2026-01-10 20:32:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-wafer-style-butterfly-valve-w-epdm-seals-and-10-position-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:32:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-1600-system-general-purpose-enamel-aerosol-white-primer-12-ounce>: HTTP status code is not handled or not allowed
2026-01-10 20:32:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-vertical-offset-charcoal-smoker-cover-45-x-18-x-52>: HTTP status code is not handled or not allowed
2026-01-10 20:32:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polycarbonate-surface-mounted-90-corner-guard-2-1-2-inch-wing-4-foot-h-clear-drilled>: HTTP status code is not handled or not allowed
2026-01-10 20:32:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-lad-saf-80-ft-vertical-safety-system-galvanized-steel-cable-6118080>: HTTP status code is not handled or not allowed
2026-01-10 20:32:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-condenser-fan-motor-blade-for-nexel-models-243005-243006>: HTTP status code is not handled or not allowed
2026-01-10 20:32:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a16h1606sslp-continuous-hinge-wclamps-type-4x-1600x1200x600in-a16p16>: HTTP status code is not handled or not allowed
2026-01-10 20:32:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/surface-mounted-end-wall-90-degrees-corners-2-ft-ft-wings-4-ft-h-w-caps-6-inch-w-chablis-recycled-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 20:32:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machine-labels-warning-flammable>: HTTP status code is not handled or not allowed
2026-01-10 20:32:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-evaporator-for-nexel-model-243004>: HTTP status code is not handled or not allowed
2026-01-10 20:32:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-evaporator-for-nexel-model-243009>: HTTP status code is not handled or not allowed
2026-01-10 20:32:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/surface-mounted-end-wall-90-degrees-corners-2-ft-ft-wings-12-ft-h-w-caps-6-inch-w-chablis-recycled-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 20:32:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-54-limit-switch-72-1-gear-ratio-w-4-contact-blocks>: HTTP status code is not handled or not allowed
2026-01-10 20:32:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/csd202012wss-conceptwall-mt-encl-wwindow-type-4x-2000x2000x1200inss-type-304>: HTTP status code is not handled or not allowed
2026-01-10 20:32:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-38-thick-x-38-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:32:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/csd303012ss-conceptwall-mt-encl-type-4x-3000x3000x1200in-ss-type-304>: HTTP status code is not handled or not allowed
2026-01-10 20:32:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bilingual-machine-labels-danger-eye-protection-required>: HTTP status code is not handled or not allowed
2026-01-10 20:32:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-332-thick-x-3-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:32:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-bar-18-thick-x-2-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:32:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nickel-plated-brass-non-drip-coupling-1-body-size-red-color-ring-nbr-seals>: HTTP status code is not handled or not allowed
2026-01-10 20:32:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14200-harmony-true-low-air-loss-tri-therapy-mattress-replacement-system>: HTTP status code is not handled or not allowed
2026-01-10 20:32:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-ss-split-body-ansi-150-flanged-ball-valve-w-sr-pneumatic>: HTTP status code is not handled or not allowed
2026-01-10 20:32:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proximity-id-badge-holder-vertical-2-3-8-x-3-3-8-clear-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:32:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/open-plan-office-desk-60-w-x-30-d-x-29-h-gray-top-with-black-legs>: HTTP status code is not handled or not allowed
2026-01-10 20:32:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-lock-solid-aluminum-rectangular-padlock-red-no-a1306red>: HTTP status code is not handled or not allowed
2026-01-10 20:32:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/restricted-area-aluminum-bilingual-authorized-employees-only>: HTTP status code is not handled or not allowed
2026-01-10 20:32:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-lab-coat-white-polycombed-cotton-tall-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:32:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-tongue-coupler-w-2in-ball-2in-channel-0091058>: HTTP status code is not handled or not allowed
2026-01-10 20:32:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/restricted-area-aluminum-high-voltage-keep-out>: HTTP status code is not handled or not allowed
2026-01-10 20:32:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-3-way-l-port-brass-npt-ball-valve-w-sr-pneumatic>: HTTP status code is not handled or not allowed
2026-01-10 20:32:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-5-16in-cast-coupler-w-5-position-channel-0091555>: HTTP status code is not handled or not allowed
2026-01-10 20:32:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24in-fifth-wheel-lube-disks-w-steel-retention-clip-fwd24>: HTTP status code is not handled or not allowed
2026-01-10 20:32:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unisex-esdanti-static-tech-coat-white-polyesternylon-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:32:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unisex-esdanti-static-tech-coat-electronic-blue-polyesternylon-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:32:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-uhmw-polyethylene-plastic-sheet-18-thick-x-12-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:32:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-2-12-thick-x-4-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:32:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/restricted-area-aluminum-do-not-enter>: HTTP status code is not handled or not allowed
2026-01-10 20:32:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-lock-solid-aluminum-rectangular-padlock-green-no-a1206grn>: HTTP status code is not handled or not allowed
2026-01-10 20:32:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machine-labels-caution-lock-out-safety-before-you-start>: HTTP status code is not handled or not allowed
2026-01-10 20:32:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-way-stamped-zinc-trailer-connector-truck-side-tc1007z>: HTTP status code is not handled or not allowed
2026-01-10 20:32:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2in-heavy-duty-ball-mount-w-4in-drop-x-7-7-8in-long-tube-1803055>: HTTP status code is not handled or not allowed
2026-01-10 20:32:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-lock-solid-aluminum-rectangular-padlock-yellow-no-a1105ylw>: HTTP status code is not handled or not allowed
2026-01-10 20:32:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vertical-pallet-lifter-lightweight-3-ton-capacity-48-fork-length-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:32:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unistrut-1-58-top-retainer-nut-for-channels-p1008teg-electro-galvanized-38-16>: HTTP status code is not handled or not allowed
2026-01-10 20:32:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/security-notice-plastic-concealed-firearms-are-prohibited-this-facility>: HTTP status code is not handled or not allowed
2026-01-10 20:32:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-lab-coat-white-polycombed-cotton-tall-52>: HTTP status code is not handled or not allowed
2026-01-10 20:32:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-lab-coat-white-polycombed-cotton-regular-4xl>: HTTP status code is not handled or not allowed
2026-01-10 20:32:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-twin-loop-100-ft-ct-zn>: HTTP status code is not handled or not allowed
2026-01-10 20:32:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-ton-combination-hitch-50-millimeter-ball-rm650m>: HTTP status code is not handled or not allowed
2026-01-10 20:32:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jumbo-roll-bath-tissue-white-1000-roll-12-rolls-case>: HTTP status code is not handled or not allowed
2026-01-10 20:32:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pin-and-cable-replacement-for-5422010-breakaway-switch-5422012>: HTTP status code is not handled or not allowed
2026-01-10 20:32:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-lab-coat-light-gray-polycombed-cotton-46>: HTTP status code is not handled or not allowed
2026-01-10 20:32:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-washer-for-w-40-xl-w-40-xt-pallet-trucks-hy-2307951>: HTTP status code is not handled or not allowed
2026-01-10 20:32:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-way-flat-to-5-way-round-plastic-trailer-connector-adapter-tc2075p>: HTTP status code is not handled or not allowed
2026-01-10 20:32:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frost-paper-cup-dispenser-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:32:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fork-riser-6000-lbs-cap-for-8300-8400-8500-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:32:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flatbed-flatbed-dump-hitch-plate-bumper-w-2in-receiver-1809055>: HTTP status code is not handled or not allowed
2026-01-10 20:32:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/odp-w-rigid-base-364t-frame-60-hp-1800-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:32:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/frost-full-wall-mounted-shower-seat-stainless-white>: HTTP status code is not handled or not allowed
2026-01-10 20:32:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hitch-plate-for-chevy-gm-3500-1809035a>: HTTP status code is not handled or not allowed
2026-01-10 20:32:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bearing-cone-for-mp-mpb-040-ac-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:32:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drive-motor-cover-for-mp-mpb-040-ac-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:32:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/odp-c-face-w-removable-base-1-2hp-1800rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:32:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/odp-w-rigid-base-2hp-1800rpm-f2-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:32:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheel-axle-for-7400-reach-pallet-trucks-all-load-wheels-except-6-x-4-closed-toe>: HTTP status code is not handled or not allowed
2026-01-10 20:32:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/handle-grip-for-8300-8400-8500-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:32:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-industrial-long-sleeve-work-shirt-gray-polycotton-regular-s>: HTTP status code is not handled or not allowed
2026-01-10 20:32:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-solid-plastic-shelving-unit-silver-epoxy-posts-24w-x-48l-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:32:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-stac-a-shelf-wire-locker-shelf-pink-7-case>: HTTP status code is not handled or not allowed
2026-01-10 20:32:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-x-96-rub-rail-060-thick-khaki-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:32:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-grid-panel-poly-green-36-x-72>: HTTP status code is not handled or not allowed
2026-01-10 20:32:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-1-14-thick-x-48-wide-x-120-long>: HTTP status code is not handled or not allowed
2026-01-10 20:32:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-industrial-long-sleeve-work-shirt-navy-polycotton-regular-s>: HTTP status code is not handled or not allowed
2026-01-10 20:32:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/konnect-sticky-note-holder-24-case-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:32:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14x36x74-chrome-wire-shelving-with-28-giant-stacking-bins-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:32:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-lock-high-security-solid-aluminum-padlock-5-pin-cylinders-red>: HTTP status code is not handled or not allowed
2026-01-10 20:32:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-quietsharp-153-6-antimicrobial-classroom-electric-pencil-sharpener-blue-4-case>: HTTP status code is not handled or not allowed
2026-01-10 20:32:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washable-school-glue-762-oz-liquid>: HTTP status code is not handled or not allowed
2026-01-10 20:32:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-general-security-combo-padlock-lh-shackle-gold-dial>: HTTP status code is not handled or not allowed
2026-01-10 20:32:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-general-security-combo-padlock-lh-shackle-green-dial>: HTTP status code is not handled or not allowed
2026-01-10 20:32:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ez-squeeze-153-spring-powered-ergonomic-stapler-black-12-case>: HTTP status code is not handled or not allowed
2026-01-10 20:33:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x74-chrome-wire-shelving-with-20-giant-stacking-bins-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:33:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-lock-built-in-combo-lock-ada-compliant-lift-handle-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:33:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-bar-3-thick-x-6-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x74-chrome-wire-shelving-with-8-giant-stacking-bins-ivory>: HTTP status code is not handled or not allowed
2026-01-10 20:33:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quietsharp-executive-electric-pencil-sharpener-6-case>: HTTP status code is not handled or not allowed
2026-01-10 20:33:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b8-174-powercrown-153-premium-staples-3-8-9mm-5000-pk-20-case>: HTTP status code is not handled or not allowed
2026-01-10 20:33:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-containment-berm-collapsible-wall-model-6-x-6>: HTTP status code is not handled or not allowed
2026-01-10 20:33:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/highland8482-transparent-tape-3-4-inch-x-1000-inch-1-inch-core-clear-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:33:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bodyroll-5-1-l-x-2-4-diameter-blue-set-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:33:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-3-thick-x-16-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powerball-45-cm-18-in-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:33:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-extension-for-all-wallboard-lifts>: HTTP status code is not handled or not allowed
2026-01-10 20:33:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-desk-tray-letter-size-10-inch-x-14-inch-x-3-inch-black>: HTTP status code is not handled or not allowed
2026-01-10 20:33:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-line-correction-tape-1-5-inch-x-39point4-feet-white-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:33:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-plastic-bar-w-lse-acrylic-adhesive-18-thick-x-4-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20229 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:33:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boost-x-12v-2500a-ultrasafe-lithium-jump-starter>: HTTP status code is not handled or not allowed
2026-01-10 20:33:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-electric-chain-hoist-motor-trolley-12-20-29>: HTTP status code is not handled or not allowed
2026-01-10 20:33:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protective-desk-pads-24-inch-x-36-inch-black>: HTTP status code is not handled or not allowed
2026-01-10 20:33:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-electric-chain-hoist-motor-trolley-1-10-14>: HTTP status code is not handled or not allowed
2026-01-10 20:33:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-duty-mixer-200-quarts-cap-air-motor-33-hp-gear-drive-4-impeller-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:33:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-dual-speed-electric-chain-hoist-18-20-559>: HTTP status code is not handled or not allowed
2026-01-10 20:33:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-electric-chain-hoist-hook-suspension-1-12-10-18>: HTTP status code is not handled or not allowed
2026-01-10 20:33:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/work-height-platform-truck-with-6-deep-deck-24-x-60-fixed-height-polyurethane-retaining-lip>: HTTP status code is not handled or not allowed
2026-01-10 20:33:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/knob-for-w-40-xl-w-40-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:33:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-plastic-bar-w-lse-acrylic-adhesive-14-thick-x-1-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tumbler-cw-13oz-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:33:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-116-thick-x-1-12-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camcover-10-5-8-amber>: HTTP status code is not handled or not allowed
2026-01-10 20:33:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hangable-two-way-organizer-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:33:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-electric-chain-hoist-push-trolley-2-20-14>: HTTP status code is not handled or not allowed
2026-01-10 20:33:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/karcher-comfort-seat-km105-sweeper-2-851-381-0>: HTTP status code is not handled or not allowed
2026-01-10 20:33:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/surface-mounted-toilet-seat-cover-black>: HTTP status code is not handled or not allowed
2026-01-10 20:33:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camcover-versa-6-1-2-antique-parchment>: HTTP status code is not handled or not allowed
2026-01-10 20:33:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ptfe-plastic-rod-38-diameter-x-4-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tumbler-dm-14oz-light-amber>: HTTP status code is not handled or not allowed
2026-01-10 20:33:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-132-thick-x-2-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-heavy-duty-led-flood-light-50w-4-8-tripod>: HTTP status code is not handled or not allowed
2026-01-10 20:33:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tumbler-dm-24oz-light-amber>: HTTP status code is not handled or not allowed
2026-01-10 20:33:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tumbler-dm-8oz-ruby-red>: HTTP status code is not handled or not allowed
2026-01-10 20:33:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-dual-speed-elec-hoist-push-trolley-1-12-15-183>: HTTP status code is not handled or not allowed
2026-01-10 20:33:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-uhmw-polyethylene-plastic-bar-18-thick-x-1-12-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-merv-11-high-capacity-xl11-pleated-panel-extended-surface-20-inch-w-x-25-inch-h-x-2-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 20:33:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slb-lever-hoists-2200-lb-capacity-20-ft-lift-14-38-head-room>: HTTP status code is not handled or not allowed
2026-01-10 20:33:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-132-thick-x-1-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-bank-top-chest-w-7-drawers-27-w-x-22-3-8-d-x-27-2-3-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:33:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xx-garolite-bar-116-thick-x-1-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/550s-top-chest-w-10-drawers-50-w-x-25-1-4-d-x-27-h-red>: HTTP status code is not handled or not allowed
2026-01-10 20:33:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-temp-sensor-for-wp-3000-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:33:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caster-wheel-assembly-for-7hbw30-pallet-trucks-to-00590-42306-71-xl-a>: HTTP status code is not handled or not allowed
2026-01-10 20:33:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pivot-block-for-wp-2300-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:33:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-merv-8-standard-capacity-xl8-pleated-panel-ext-surface-24-inch-w-x-30-inch-h-x-1-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 20:33:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modular-utility-cart-w-3-drawers-37-l-x-20-d-x-43-h-red>: HTTP status code is not handled or not allowed
2026-01-10 20:33:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-merv-8-standard-capacity-xl8-pleated-panel-ext-surface-16-inch-w-x-20-inch-h-x-4-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 20:33:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-electric-chain-hoist-motor-trolley-1-10-28>: HTTP status code is not handled or not allowed
2026-01-10 20:33:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-double-adjustable-shelf-bracket-poly-green-8482>: HTTP status code is not handled or not allowed
2026-01-10 20:33:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-merv-13-high-capacity-extended-surface-multi-pleat-green-18-inch-w-x-24-inch-h-x-4-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 20:33:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-174-poly-green-174-wire-ledge-14-w-x-4-h>: HTTP status code is not handled or not allowed
2026-01-10 20:33:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-full-strip-metal-stapler-20-sheet-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 20:33:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koch-filter-merv-8-high-capacity-xl8-pleated-extended-surface-14-inch-w-x-20-inch-h-x-1-inch-d>: HTTP status code is not handled or not allowed
2026-01-10 20:33:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/top-chest-w-5-drawers-34-w-x-25-1-4-d-x-27-h-red>: HTTP status code is not handled or not allowed
2026-01-10 20:33:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x74-chrome-wire-shelving-with-24-quickpick-double-open-bins-blue-2>: HTTP status code is not handled or not allowed
2026-01-10 20:33:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x42x75-steel-shelving-with-15-magnum-giant-hopper-bins-red>: HTTP status code is not handled or not allowed
2026-01-10 20:33:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-sner-electric-chain-hoist-hook-suspension-14-10-14>: HTTP status code is not handled or not allowed
2026-01-10 20:33:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21u-v-line-wall-mount-rack-18-depth>: HTTP status code is not handled or not allowed
2026-01-10 20:33:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-34-thick-x-12-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/300-series-tool-chest-w-5-drawers-26-w-x-12-d-x-20-1-2-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:33:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-bank-top-chest-w-12-drawers-42-w-x-22-3-8-d-x-27-2-3-h-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:33:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-uhmw-polyethylene-plastic-bar-3-thick-x-4-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-flat-polyurethane-coated-gloves-white-large-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:33:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x42x74-chrome-shelving-with-18-magnum-giant-hopper-bins-green>: HTTP status code is not handled or not allowed
2026-01-10 20:33:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-flat-polyurethane-coated-gloves-white-x-large-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:33:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/27u-linier-server-cabinet-vented-vented-doors-36-depth>: HTTP status code is not handled or not allowed
2026-01-10 20:33:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20w-smart-solar-led-street-light-with-integrated-lithium-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:33:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72x36-maple-square-edge-mobile-power-apron-production-bench-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:33:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60w-ultra-high-powered-solar-led-street-light>: HTTP status code is not handled or not allowed
2026-01-10 20:33:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solar-powered-garden-led-light-white-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 20:33:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cast-acrylic-plastic-sheet-18-thick-x-48-wide-x-72-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100w-solar-panel-with-650wh-battery-4-cameras>: HTTP status code is not handled or not allowed
2026-01-10 20:33:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-bar-1-14-thick-x-5-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-uhmw-polyethylene-plastic-sheet-2-12-thick-x-8-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harrington-ner-electric-chain-hoist-motor-trolley-2-20-14>: HTTP status code is not handled or not allowed
2026-01-10 20:33:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/solar-power-ai-smart-1600-lumens-cree-led-parking-light>: HTTP status code is not handled or not allowed
2026-01-10 20:33:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-5306zz-double-row-angular-contact-bearing-double-shielded-30mm-bore-x-72mm-od-x-30-2mm-w>: HTTP status code is not handled or not allowed
2026-01-10 20:33:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-12-thick-x-8-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:33:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-5200-2ns-double-row-angular-contact-double-sealed-10mm-bore-x-30mm-od-x-14-3mm-w>: HTTP status code is not handled or not allowed
2026-01-10 20:33:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-for-w-40z-b218-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:33:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bushing-for-mpb-040-e-b827-mpw-045-e-b802-pallet-trucks-yl-524149643>: HTTP status code is not handled or not allowed
2026-01-10 20:33:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nachi-5210-2ns-double-row-angular-contact-bearing-double-sealed-50mm-bore-x-90mm-od-x-30-2mm-w>: HTTP status code is not handled or not allowed
2026-01-10 20:33:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tandem-load-wheel-assembly-for-pe-4500-pallet-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:33:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/material-handling-basket-16l-x-10w-x-3-15-16h-0-25-wire-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:33:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graduated-histology-container-500ml-16-oz-polypropylene-yellow-screwcap-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:33:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-lid-for-6-5-oz-specimen-containers-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:33:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/119-series-forklift-tire-chains-pair-1196055>: HTTP status code is not handled or not allowed
2026-01-10 20:33:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x36x74-chrome-wire-shelving-with-77-4-h-shelf-bins-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:33:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crc-3-36-multi-purpose-lubricant-corrosion-inhibitor-16-oz-aerosol-can>: HTTP status code is not handled or not allowed
2026-01-10 20:33:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crc-knocker-loose-penetrating-solvents-16-oz-aerosol-can>: HTTP status code is not handled or not allowed
2026-01-10 20:33:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x36x74-chrome-wire-shelving-with-33-4-h-shelf-bins-red>: HTTP status code is not handled or not allowed
2026-01-10 20:33:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x36x74-chrome-wire-shelving-with-33-4-h-shelf-bins-ivory>: HTTP status code is not handled or not allowed
2026-01-10 20:33:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/biohazard-specimen-transport-bag-6-x-9-zipper-score-line-document-pouch-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:34:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x74-chrome-wire-shelving-with-55-4-h-shelf-bins-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:34:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x74-chrome-wire-shelving-with-33-4-h-shelf-bins-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:34:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optional-type-gs-grooved-toe-plate-for-liftkar-sal-stair-climbing-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:34:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optional-type-xwl-grooved-toe-plate-for-liftkar-sal-stair-climbing-trucks>: HTTP status code is not handled or not allowed
2026-01-10 20:34:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24x36x74-chrome-wire-shelving-with-77-4-h-shelf-bins-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:34:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-34-thick-x-8-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-for-mp-mpb-040-ac-pallet-trucks-yl-065269600-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:34:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ballymore-12-step-serrated-cantilever-ladder-28-overhang>: HTTP status code is not handled or not allowed
2026-01-10 20:34:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-canvas-elevated-basket-bulk-truck-6-bushel-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:34:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-plastic-bar-w-lse-acrylic-adhesive-12-thick-x-1-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-14-red-13-oz-flame-retardant-vinyl>: HTTP status code is not handled or not allowed
2026-01-10 20:34:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/royal-basket-trucks-174-linen-cart-19-5-cu-ft-29-l-x-29-w-x-47-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:34:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stinger-berm-spill-containment-puncture-resistant-4-l-x-4-w-x-8-h>: HTTP status code is not handled or not allowed
2026-01-10 20:34:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/royal-basket-trucks-174-linen-cart-19-5-cu-ft-29-l-x-29-w-x-47-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:34:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/collarless-butcher-wrap-wexterior-pockets-white-polyestercombed-cotton-4xl>: HTTP status code is not handled or not allowed
2026-01-10 20:34:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/econo-long-haul-truck-spill-kit-oil-only-absorbs-up-to-25-gallons>: HTTP status code is not handled or not allowed
2026-01-10 20:34:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20329 pages (at 100 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:34:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12x36x39-steel-shelving-with-20-6-h-shelf-bins-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:34:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-inch-return-in-dark-cherry-executive-modular-furniture>: HTTP status code is not handled or not allowed
2026-01-10 20:34:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-2-thick-x-36-long-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-drawer-lateral-file-in-dark-cherry-executive-modular-furniture>: HTTP status code is not handled or not allowed
2026-01-10 20:34:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stinger-berm-spill-containment-puncture-resistant-6-l-x-6-w-x-12-h>: HTTP status code is not handled or not allowed
2026-01-10 20:34:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-drawer-hanging-pedestal-in-dark-cherry-executive-modular-furniture>: HTTP status code is not handled or not allowed
2026-01-10 20:34:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-button-front-chef-coat-thermometer-pocket-cloth-buttons-white-polycotton-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:34:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-sheet-3-thick-x-32-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-pocket-chart-holder-medium-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:34:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/axle-shaft-for-wpt45-pallet-trucks-cl-1120-130010-10>: HTTP status code is not handled or not allowed
2026-01-10 20:34:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdpe-plastic-bar-12-thick-x-6-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-clamp-alligator-clip-w-10-ft-7x19-stranded-flex-steel-cable>: HTTP status code is not handled or not allowed
2026-01-10 20:34:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-clamp-alligator-clip-w-5-ft-7x19-stranded-flex-steel-cable>: HTTP status code is not handled or not allowed
2026-01-10 20:34:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xx-garolite-bar-1-thick-x-1-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cast-acrylic-plastic-sheet-14-thick-x-16-wide-x-16-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-pocket-4h-acrylic-oak-wall-display-light-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:34:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-34-thick-x-2-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-ft-nylon-covered-7x7-stranded-steel-static-discharge-reel>: HTTP status code is not handled or not allowed
2026-01-10 20:34:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spx223-electronic-portable-balance-with-lcd-display-220g-x-0-001g>: HTTP status code is not handled or not allowed
2026-01-10 20:34:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheelbarrow-ladder-9-steps-aluminum-350-lb-capacity-14-d-top-step-24-w-step>: HTTP status code is not handled or not allowed
2026-01-10 20:34:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/50-ft-orange-nylon-covered-7x7-stranded-steel-static-discharge-reel>: HTTP status code is not handled or not allowed
2026-01-10 20:34:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gas-spring-for-w-40z-b218-45z-c215-pallet-trucks-hy-2098777>: HTTP status code is not handled or not allowed
2026-01-10 20:34:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-boot-16-black-steel-toe-steel-mid-sole-pvc-size-7>: HTTP status code is not handled or not allowed
2026-01-10 20:34:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-for-w-40z-b218-45z-c215-pallet-trucks-hy-4609400>: HTTP status code is not handled or not allowed
2026-01-10 20:34:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-8482-outdoor-pedestal-drinking-w-water-filter-ss>: HTTP status code is not handled or not allowed
2026-01-10 20:34:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-pocket-counter-top-business-card-holder-mahogany>: HTTP status code is not handled or not allowed
2026-01-10 20:34:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-10-viking-yellow-overshoe-w-4-way-cleated-outsole-pvc-size-small>: HTTP status code is not handled or not allowed
2026-01-10 20:34:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-stage-snow-blower-auger-right>: HTTP status code is not handled or not allowed
2026-01-10 20:34:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peek-plastic-bar-34-thick-x-2-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tension-bar-end-for-wp-2000-pallet-trucks-cr-045292-001>: HTTP status code is not handled or not allowed
2026-01-10 20:34:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-piece-interlocking-multi-purpose-storage-compartment-organizer-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:34:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-wheel-kit-for-manual-pallet-jack-gwk-vj2-ck-valu-jack-model-5500-2-hydraulic-unit>: HTTP status code is not handled or not allowed
2026-01-10 20:34:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-wheel-kit-for-manual-pallet-jack-gwk-hpt25-ck-fits-toyota-model-hpt25>: HTTP status code is not handled or not allowed
2026-01-10 20:34:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-w-lse-acrylic-adhesive-132-thick-x-24-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-boot-6-polyblend-black-steel-toe-w-cleated-outsole-pvc-size-8>: HTTP status code is not handled or not allowed
2026-01-10 20:34:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-electric-pallet-jack-truck-gwk-b60z-lw-fits-hyster-model-b60z>: HTTP status code is not handled or not allowed
2026-01-10 20:34:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xx-garolite-sheet-38-thick-x-6-wide-x-6-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x63-chrome-wire-truck-with-12-8-h-grid-containers-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:34:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-acetal-plastic-sheet-w-lse-acrylic-adhesive-116-thick-x-12-wide-x-24-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-sanitex-green-bib-overall-plain-front-pvc-on-polyester-size-4x>: HTTP status code is not handled or not allowed
2026-01-10 20:34:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-sitex-48-yellow-coat-w-detachable-hood-pvc-size-small>: HTTP status code is not handled or not allowed
2026-01-10 20:34:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-15-yellow-steel-toe-boot-polyurethane-size-8>: HTTP status code is not handled or not allowed
2026-01-10 20:34:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/35-lb-table-umbrella-base-bronze-mist>: HTTP status code is not handled or not allowed
2026-01-10 20:34:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-sitex-yellow-3-piece-suit-pvc-size-4x>: HTTP status code is not handled or not allowed
2026-01-10 20:34:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/siesta-air-resin-bar-stool-white>: HTTP status code is not handled or not allowed
2026-01-10 20:34:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-sitex-yellow-2-piece-suit-w-elastic-waist-pants-pvc-size-2x>: HTTP status code is not handled or not allowed
2026-01-10 20:34:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-sitex-yellow-2-piece-suit-w-elastic-waist-pants-pvc-size-3x>: HTTP status code is not handled or not allowed
2026-01-10 20:34:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-pedestal-post-cd-premium-fan-292650>: HTTP status code is not handled or not allowed
2026-01-10 20:34:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x60x74-chrome-wire-shelving-with-88-shelf-bins-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:34:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-sitex-yellow-jacket-w-detachable-hood-pvc-size-extra-large>: HTTP status code is not handled or not allowed
2026-01-10 20:34:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-pedestal-base-cd-premium-fan-292650>: HTTP status code is not handled or not allowed
2026-01-10 20:34:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-tuftex-yellow-bib-overall-plain-front-pvc-size-3x>: HTTP status code is not handled or not allowed
2026-01-10 20:34:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18x36x74-chrome-wire-shelving-with-36-6-h-nest-stack-shipping-totes-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:34:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24x60x74-chrome-wire-shelving-with-88-shelf-bins-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:34:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-sanitex-green-bib-overall-plain-front-pvc-on-polyester-size-small>: HTTP status code is not handled or not allowed
2026-01-10 20:34:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v-edge-personal-fall-limiter-8-stainles-steel-cable-twin-leg-snap-hook-63162-00e>: HTTP status code is not handled or not allowed
2026-01-10 20:34:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/semi-clear-fda-silicone-rubber-sheet-whigh-temp-adhesive-60a-132-thick-x-36w-x-36l>: HTTP status code is not handled or not allowed
2026-01-10 20:34:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/male-upper-plastic-form-on-faux-crystal-base-white>: HTTP status code is not handled or not allowed
2026-01-10 20:34:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leadhead-auto-darkening-welding-helmet-manual-98x87mm-flame>: HTTP status code is not handled or not allowed
2026-01-10 20:34:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/male-34-body-form-black-wblack-wood-tripod-base>: HTTP status code is not handled or not allowed
2026-01-10 20:34:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/baseball-bump-cap-hi-vis-lime-baseball-bumps-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:34:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/base-for-body-forms-12-x-12-x-30h>: HTTP status code is not handled or not allowed
2026-01-10 20:34:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/epdm-rubber-sheet-no-adhesive-60a-18-thick-x-18-wide-x-18-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/female-mannequin-headless-hands-by-side-legs-apart-matte-finish>: HTTP status code is not handled or not allowed
2026-01-10 20:34:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-stacking-bin-5-1-2x14-3-4x5-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:34:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cbrn-canister-for-millennium-gas-mask-threaded-10046570>: HTTP status code is not handled or not allowed
2026-01-10 20:34:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extruded-aluminum-hose-cable-bridge-yellow-48-x-718-x-1116>: HTTP status code is not handled or not allowed
2026-01-10 20:34:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extruded-aluminum-hose-cable-bridge-yellow-5978-x-918-x-112>: HTTP status code is not handled or not allowed
2026-01-10 20:34:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extruded-aluminum-hose-cable-bridge-yellow-36-x-278-x-716>: HTTP status code is not handled or not allowed
2026-01-10 20:34:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extruded-aluminum-hose-cable-bridge-yellow-24-x-718-x-1116>: HTTP status code is not handled or not allowed
2026-01-10 20:34:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-w-lse-acrylic-adhesive-18-thick-x-1-12-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polycarbonate-plastic-tube-1-id-x-1-14-od-x-2-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gray-plastic-self-dumping-forkli-hopper-5-8-cu-yd>: HTTP status code is not handled or not allowed
2026-01-10 20:34:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grade-f1-felt-strip-no-adhesive-14-thick-x-1-wide-x-10-ft-long>: HTTP status code is not handled or not allowed
2026-01-10 20:34:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-diamond-5-12-needle-file-round-pattern-grit-220-fine>: HTTP status code is not handled or not allowed
2026-01-10 20:34:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ridgeline-xr7-hard-hat-with-6-point-ratchet-black-graph>: HTTP status code is not handled or not allowed
2026-01-10 20:34:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/milwaukee-6-5-tpi-sawzall-blades-5-48-00-5035>: HTTP status code is not handled or not allowed
2026-01-10 20:34:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blue-hinged-lid-1-1-cu-yd-self-dumping-plastic-hopper>: HTTP status code is not handled or not allowed
2026-01-10 20:34:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-office-partition-panel-24-1-4w-x-60h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:34:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-boot-16-economy-black-steel-toe-steel-mid-sole-pvc-size-6>: HTTP status code is not handled or not allowed
2026-01-10 20:34:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-56-6-chest-wader-black-steel-toe-w-cleated-outsole-pvc-size-13>: HTTP status code is not handled or not allowed
2026-01-10 20:34:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-office-partition-panel-48-1-4w-x-60h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:35:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onguard-men-s-boot-14-white-plain-toe-w-safety-lock-pvc-size-7>: HTTP status code is not handled or not allowed
2026-01-10 20:35:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-1-14-thick-x-4-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:35:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freezing-box-3-cardboard-64-place-8x8-format-fits-3ml-4ml-and-5ml-cryoclear-vials-white>: HTTP status code is not handled or not allowed
2026-01-10 20:35:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slide-box-for-100-slides-cork-lined-red>: HTTP status code is not handled or not allowed
2026-01-10 20:35:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/energy-abs-w-pack-6-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:35:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vest-full-body-harness-hi-viz-yellow-large>: HTTP status code is not handled or not allowed
2026-01-10 20:35:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4826-w-yorkshire-window-box-white-vinyl-15-gallon-capacity-72-x-10-x-12>: HTTP status code is not handled or not allowed
2026-01-10 20:35:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-bar-3-thick-x-6-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:35:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spring-loaded-roll-up-bug-door-with-pvc-coated-blue-vinyl-panels-10-x-10>: HTTP status code is not handled or not allowed
2026-01-10 20:35:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-sloped-shelf-portable-bin-cart-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:35:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-profile-span-track-42-d-x-12-w-for-2-1-2-w-step-beams-796935>: HTTP status code is not handled or not allowed
2026-01-10 20:35:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-cap-screw-m8-x-1-25-x-75mm-steel-zinc-yellow-class-10-9-din-931-pkg-of-50-aar08075>: HTTP status code is not handled or not allowed
2026-01-10 20:35:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lau-three-quarter-in-bore-interchangeable-hub-for-4-blade-propellers>: HTTP status code is not handled or not allowed
2026-01-10 20:35:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-acetal-plastic-sheet-1-14-thick-x-12-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:35:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-nut-m16-x-2-0-steel-zinc-clear-class-8-8-din-934-pkg-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:35:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cap-flange-plug-13mm-green-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:35:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20427 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:35:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dome-vinyl-padded-stack-chair-french-beige-seatmocha-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:35:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-office-partition-panel-with-window-36-1-4w-x-42h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:35:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/americana-cap-with-accessory-slots-and-4-point-slide-lock-suspension-black>: HTTP status code is not handled or not allowed
2026-01-10 20:35:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-battery-6v-200ah-agm-c49r-641748-sweeper>: HTTP status code is not handled or not allowed
2026-01-10 20:35:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hitech-ultracompact-stack-chair-black>: HTTP status code is not handled or not allowed
2026-01-10 20:35:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rfid-electronic-locker-lock-user-card-access-for-right-hinged-doors-5154>: HTTP status code is not handled or not allowed
2026-01-10 20:35:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hard-hat-safety-light-amber>: HTTP status code is not handled or not allowed
2026-01-10 20:35:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-uhmw-polyethylene-plastic-bar-14-thick-x-14-wide-x-48-long>: HTTP status code is not handled or not allowed
2026-01-10 20:35:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uhmw-polyethylene-plastic-bar-18-thick-x-34-wide-x-12-long>: HTTP status code is not handled or not allowed
2026-01-10 20:35:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fb-pic4188m-luxury-color-sewer-drain-camera-130-cable-w-sonde-transmitter>: HTTP status code is not handled or not allowed
2026-01-10 20:35:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/slide-cabinet-base-metal-white>: HTTP status code is not handled or not allowed
2026-01-10 20:35:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/built-in-cylinder-key-lock-dead-bolt-keyed-diff-2-user-keys-and-control-key>: HTTP status code is not handled or not allowed
2026-01-10 20:35:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tach-it-usp15-general-purpose-tagging-fasteners>: HTTP status code is not handled or not allowed
2026-01-10 20:35:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waterproof-quilted-thermal-bib-rain-pants-ansi-isea-class-e-lime-black-m-lqbbip-ce-m>: HTTP status code is not handled or not allowed
2026-01-10 20:35:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-only-heavy-weight-sorbent-pads-24-gallon-capacity-15-x-18-100-padsbag>: HTTP status code is not handled or not allowed
2026-01-10 20:35:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-skatewheel-conveyor-18-oaw-5-oal-16-wpf>: HTTP status code is not handled or not allowed
2026-01-10 20:35:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-culture-tube-cap-for-18mm-glass-culture-tubes-polypropylene-green-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:35:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-shelf-mobile-computer-lanstation-sliding-keyboard-tray-5-casters-2-locking-75-hx24-wx72-l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:35:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transfer-pipet-70ml-large-bulb-graduated-to-3ml-155mm-5000-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:35:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/americana-full-brim-with-4-point-mega-ratchet-suspension-hi-viz-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:35:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omega-ii-cap-with-accessory-slots-and-6-point-slide-lock-suspension-gold>: HTTP status code is not handled or not allowed
2026-01-10 20:35:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-drawer-bench-high-36-w-cabinet-avalanche-blue-2>: HTTP status code is not handled or not allowed
2026-01-10 20:35:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shop-crane-tagline-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:35:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ansi-retroreflective-strip-5-x-22-l-white-order-by-the-sheet-7-strips>: HTTP status code is not handled or not allowed
2026-01-10 20:35:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/transfer-pipet-60ml-extra-long-225mm-9-inches-long-sterile-polypropylenes-400-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:35:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/i675-americana-vent-slide-lock-suspension>: HTTP status code is not handled or not allowed
2026-01-10 20:35:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/matrix-guard-panel-10-w-x-2-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:35:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/matrix-guard-panel-5-10-w-x-2-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:35:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/turbo-shrub-spray-gun>: HTTP status code is not handled or not allowed
2026-01-10 20:35:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-bin-cabinet-16-yellow-hook-on-bins-3-adj-shelves-36w-24d-78h>: HTTP status code is not handled or not allowed
2026-01-10 20:35:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-bin-cabinet-138-yellow-hook-on-bins-36w-24d-84h>: HTTP status code is not handled or not allowed
2026-01-10 20:35:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-bin-cabinet-185-red-hook-on-bins-3-adj-shelves-60w-24d-84h>: HTTP status code is not handled or not allowed
2026-01-10 20:35:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-inch-variangle-thermometer-3-1-2-inch-stem-30-240f>: HTTP status code is not handled or not allowed
2026-01-10 20:35:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100g-deicing-sprayer-55hp-ge660-pump-75-12-hose-manual-reel>: HTTP status code is not handled or not allowed
2026-01-10 20:35:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-drawer-counter-high-36-w-cabinet-black-2>: HTTP status code is not handled or not allowed
2026-01-10 20:35:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-drawer-counter-high-36-w-cabinet-avalanche-blue-3>: HTTP status code is not handled or not allowed
2026-01-10 20:35:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm1050vs2-w-led-wklmp-spndl-grd>: HTTP status code is not handled or not allowed
2026-01-10 20:35:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cantilever-umbrella-with-crank-tilt-cross-brace-olefin-fabric-10-w-red>: HTTP status code is not handled or not allowed
2026-01-10 20:35:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-x13-first-classflat-envelopes>: HTTP status code is not handled or not allowed
2026-01-10 20:35:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mesh-task-chair-seat-slider-fabric-ocean-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:35:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/centrifuge-tube-15ml-polypropylene-molded-graduations-250-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:35:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nps-wood-science-lab-table-24-x-60-x-36-whiteboard-top>: HTTP status code is not handled or not allowed
2026-01-10 20:35:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nps-steel-height-adjustable-science-lab-table-24-x-54-hpl-top-black>: HTTP status code is not handled or not allowed
2026-01-10 20:35:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-flat-panel-turntable-black>: HTTP status code is not handled or not allowed
2026-01-10 20:35:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gh-1440-3-lathe-with-newall-dp500-dro-and-collet-closer>: HTTP status code is not handled or not allowed
2026-01-10 20:35:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/diamond-midi-centrifuge-tube-50ml-polypropylene-attached-snap-cap-graduated-yellow-200-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:35:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boss-antimicrobial-guest-chair-500-lb-weight-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:35:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/notrax-chevron-105-indoor-entrance-mat-3x4-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 20:35:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4in-triple-round-polished-stainless-steel-light-box-w-knockouts>: HTTP status code is not handled or not allowed
2026-01-10 20:35:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-drawer-counter-high-30-w-cabinet-everest-blue-1>: HTTP status code is not handled or not allowed
2026-01-10 20:35:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polly-products-polly-tuff-easy-access-6ft-picnic-table-cedar-top-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:35:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-x-2000-prestretch-film-423066>: HTTP status code is not handled or not allowed
2026-01-10 20:35:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wireless-tube-rack-16mm-full-size-72-place-nylon-green>: HTTP status code is not handled or not allowed
2026-01-10 20:35:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-drawer-full-height-36-w-cabinet-avalanche-blue-1>: HTTP status code is not handled or not allowed
2026-01-10 20:35:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/refrigerator-reach-in-1-section-24-78w-23-38d-63-18h-t-12g>: HTTP status code is not handled or not allowed
2026-01-10 20:35:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-drawer-bench-high-30-w-cabinet-light-gray-2>: HTTP status code is not handled or not allowed
2026-01-10 20:35:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-drawer-full-height-36-w-cabinet-red-1>: HTTP status code is not handled or not allowed
2026-01-10 20:35:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-1254rvs-with-acu-rite-203-3x-q-dro-x-y-z-powerfeeds-air-power-drawbar>: HTTP status code is not handled or not allowed
2026-01-10 20:35:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/41-series-manifold-42021>: HTTP status code is not handled or not allowed
2026-01-10 20:35:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-drawer-bench-high-36-w-cabinet-beige-4>: HTTP status code is not handled or not allowed
2026-01-10 20:35:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/41-series-manifold-with-60in-ball-valve-hoses-41315>: HTTP status code is not handled or not allowed
2026-01-10 20:35:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-magnetic-centering-head>: HTTP status code is not handled or not allowed
2026-01-10 20:35:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-camwear-spoon-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:35:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/11-camwear-spoon-white>: HTTP status code is not handled or not allowed
2026-01-10 20:35:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-eye-bolt-seb-u-100>: HTTP status code is not handled or not allowed
2026-01-10 20:35:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/back-bar-cooler-2-section-61-18w-24-14d-35-58h-tbb-24-60g>: HTTP status code is not handled or not allowed
2026-01-10 20:35:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ante-brush-belt-for-push-sweeper-ref7-rp9019>: HTTP status code is not handled or not allowed
2026-01-10 20:35:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jmd-45g-hpf-geared-head-sq-col-mill-drill-power-downfeed-dp700-dro-x-axis-powerfeed>: HTTP status code is not handled or not allowed
2026-01-10 20:35:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-swivel-ring-dsr-m-30>: HTTP status code is not handled or not allowed
2026-01-10 20:35:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/freezer-merch-2-section-47-18w-29-78d-78-58h-gdm-43f>: HTTP status code is not handled or not allowed
2026-01-10 20:35:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss-double-swivel-ring-m12h>: HTTP status code is not handled or not allowed
2026-01-10 20:35:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-174-refrigerated-cake-display-case-12-7-cu>: HTTP status code is not handled or not allowed
2026-01-10 20:35:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-anti-foam-additive-case-of-four-1-gallon-bottles>: HTTP status code is not handled or not allowed
2026-01-10 20:35:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jwds-1020-benchtop-drum-sander>: HTTP status code is not handled or not allowed
2026-01-10 20:35:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-deluxe-literature-mailer-12-x-10-x-6->: HTTP status code is not handled or not allowed
2026-01-10 20:35:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beaker-with-handle-diamond-essentials-low-form-printed-graduations-pmp-250ml>: HTTP status code is not handled or not allowed
2026-01-10 20:35:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/draft-beer-cooler-69-18w-27-18d-37h-tdd-3>: HTTP status code is not handled or not allowed
2026-01-10 20:35:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/14in-heavy-duty-exhaust-fan-with-integrated-shutter-if14-1400-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:35:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2925-6300-arm-hook-polished-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:35:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-1254vs-with-acu-rite-203-3x-k-dro-x-y-powerfeeds>: HTTP status code is not handled or not allowed
2026-01-10 20:35:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tong-6-scallop-red>: HTTP status code is not handled or not allowed
2026-01-10 20:35:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tong-6-flat-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:35:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tube-stand-reinforced-polypropylene-32mm-12-place-white>: HTTP status code is not handled or not allowed
2026-01-10 20:35:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kraft-easy-fold-mailer-18-x-12-x-2>: HTTP status code is not handled or not allowed
2026-01-10 20:36:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/etm-949-mill-with-3-axis-acu-rite-300-knee-dro-and-x-y-axis-jet-powerfeeds>: HTTP status code is not handled or not allowed
2026-01-10 20:36:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-welded-gear-locker-with-door-foot-locker-24x24x72-putty>: HTTP status code is not handled or not allowed
2026-01-10 20:36:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c10-bump-cap-for-minor-bumps-with-absorbent-brow-pad-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:36:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-corrugated-boxes-19-x-6-x-4>: HTTP status code is not handled or not allowed
2026-01-10 20:36:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/etm-949-mill-with-3-axis-acu-rite-303-quill-dro-and-x-y-axis-jet-powerfeeds>: HTTP status code is not handled or not allowed
2026-01-10 20:36:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72x36-mobile-shop-top-safety-edge-work-bench-fixed-height-1-3-4-top>: HTTP status code is not handled or not allowed
2026-01-10 20:36:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-barbed-equal-tee-glass-filled-black-nylon>: HTTP status code is not handled or not allowed
2026-01-10 20:36:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-corrugated-mailer-14-x-4-x-2->: HTTP status code is not handled or not allowed
2026-01-10 20:36:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-inch-barbed-straight-coupler-white-nylon>: HTTP status code is not handled or not allowed
2026-01-10 20:36:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-8-inch-barbed-straight-coupler-316l-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:36:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/purell-push-style-soap-dispenser-es4-graphite-1200ml-5034-01>: HTTP status code is not handled or not allowed
2026-01-10 20:36:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kraft-corrugated-sheets-36-x-60>: HTTP status code is not handled or not allowed
2026-01-10 20:36:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60x30-mobile-plastic-safety-edge-work-bench-adjustable-height-1-5-8-top>: HTTP status code is not handled or not allowed
2026-01-10 20:36:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foam-nitrile-coated-gloves-gray-black-medium-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:36:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/egh-1740-with-newall-dp700-dro-with-collet-closer>: HTTP status code is not handled or not allowed
2026-01-10 20:36:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20526 pages (at 99 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:36:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/egh-1740-with-acu-rite-203-dro>: HTTP status code is not handled or not allowed
2026-01-10 20:36:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bridge-for-aluminum-nesting-dunnage-rack-24x24>: HTTP status code is not handled or not allowed
2026-01-10 20:36:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tube-stand-reinforced-polypropylene-16mm-31-place-red>: HTTP status code is not handled or not allowed
2026-01-10 20:36:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ch-400v-climbing-style-hard-hat-industrial-6-pt-suspension-vented-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:36:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/display-rectangular-cover-18x26-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:36:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackbin-4000-series-electric-lift-esd-square-edge-48-w-x-36-d-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:36:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1852-sl-6-5-8-x-1-4-double-cut-included-angle-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/melamine-dry-erase-whiteboard-4-x-8-double-sided-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:36:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/etm-949-mill-3-axis-acu-rite-203-knee-dro-x-y-z-axis-jet-pwrfds-usa-pwrd-draw-bar>: HTTP status code is not handled or not allowed
2026-01-10 20:36:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/market-tray-9x18-black>: HTTP status code is not handled or not allowed
2026-01-10 20:36:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1847-sc-11-1-4-x-1-8-double-cut-cylindrical-ball-nose-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/madarin-red-tissue-paper-20-x-30>: HTTP status code is not handled or not allowed
2026-01-10 20:36:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackbin-3505-series-hardboard-over-stainless-60-w-x-36-d-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:36:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackbin-3505-series-hardboard-over-stainless-96-w-x-36-d-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:36:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evs-949-mill-3-axis-newall-dp700-knee-dro-x-axis-jet-powerfeed-usa-powered-drw-br>: HTTP status code is not handled or not allowed
2026-01-10 20:36:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wireless-microtube-rack-with-handles-for-15ml-and-20ml-microcentrifuge-tubes-24-place-red>: HTTP status code is not handled or not allowed
2026-01-10 20:36:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1850-sm-51-1-4-x-1-8-standard-cut-pointed-cone-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-corrugated-mailer-6-x-5-x-5->: HTTP status code is not handled or not allowed
2026-01-10 20:36:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-ton-shop-press-with-plc-and-portable-power-unit-1-phase-230-volt>: HTTP status code is not handled or not allowed
2026-01-10 20:36:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-stock-picking-ladder-abrasive-tread-spl-6-14nr>: HTTP status code is not handled or not allowed
2026-01-10 20:36:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1853-sd-51-6-35mm-x-6-35mm-double-cut-ball-shaped-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-ton-bender-and-portable-power-unit-1-phase-230-volt>: HTTP status code is not handled or not allowed
2026-01-10 20:36:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/54-industrial-duty-exhaust-fan-1-phase-3-4-hp>: HTTP status code is not handled or not allowed
2026-01-10 20:36:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-boxes-10-x-10-x-14->: HTTP status code is not handled or not allowed
2026-01-10 20:36:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/artificial-christmas-tree-7-5-ft-norway-pine-clear-smart-lights>: HTTP status code is not handled or not allowed
2026-01-10 20:36:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/officejet-250-mobile-all-in-one-printer>: HTTP status code is not handled or not allowed
2026-01-10 20:36:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kraft-literature-mailer-11-1-8-x-8-3-4-x-3>: HTTP status code is not handled or not allowed
2026-01-10 20:36:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-cantilever-arm-48-inch-2600-no-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:36:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/artificial-christmas-tree-6-5-ft-greenland-tree-multi-led-lights>: HTTP status code is not handled or not allowed
2026-01-10 20:36:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-sided-cantilever-192-inch-upright-72-inch-brace-kit-adder>: HTTP status code is not handled or not allowed
2026-01-10 20:36:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-totally-enclosed-high-pressure-exhaust-fan-1-phase-1-hp>: HTTP status code is not handled or not allowed
2026-01-10 20:36:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-pump-parpmp01620b-for-hurricane-370>: HTTP status code is not handled or not allowed
2026-01-10 20:36:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1845-sa-2-5-16-x-1-4-standard-cut-cylindrical-bur-w-o-end-cut>: HTTP status code is not handled or not allowed
2026-01-10 20:36:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microcentrifuge-tube-15ml-polypropylene-yellow-stand-up-zipbag-mg-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:36:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/securall-4-cylinder-vertical-lp-oxygen-cabinet-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:36:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pipette-diamond-pro-fixed-volume-2000ul-2ml-light-green>: HTTP status code is not handled or not allowed
2026-01-10 20:36:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-boxes-21-x-15-x-15>: HTTP status code is not handled or not allowed
2026-01-10 20:36:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lt241g11-supreme-1-hole-sg-lavatory-colonial-white>: HTTP status code is not handled or not allowed
2026-01-10 20:36:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-explosion-proof-wet-environment-duct-fan-1-phase-3-4-hp>: HTTP status code is not handled or not allowed
2026-01-10 20:36:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss15412-elongated-trad-softclose-seat-sedona-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:36:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/open-front-smoking-shelter-freestanding-7-ft-w-x-3-ft-6-inch-d-x-7-ft-11-inch-h-clear-roof>: HTTP status code is not handled or not allowed
2026-01-10 20:36:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m8-x-1-25-x-45mm-machine-screw-phillips-pan-head-class-4-8-steel-zinc-50-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:36:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/securall-extra-shelf-for-cabinets-43w-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:36:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/securall-36x18x72-flammable-spill-containment-cabinet-white>: HTTP status code is not handled or not allowed
2026-01-10 20:36:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1851-se-1-1-4-x-1-4-standard-cut-egg-shaped-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1853-sd-11-1-8-x-1-4-standard-cut-ball-shaped-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1853-sd-2-5-16-x-1-4-standard-cut-ball-shaped-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-security-shelving-unit-36-x18-x-66>: HTTP status code is not handled or not allowed
2026-01-10 20:36:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kraft-jumbo-mailer-30-x-22-x-6>: HTTP status code is not handled or not allowed
2026-01-10 20:36:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/44xl100-standard-timing-belt-xl-1-x-4-3-8-t22-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 20:36:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1847-sc-2-7-94mm-x-19-1mm-cylindrical-ball-nose-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-shutters-48-exhaust-fans>: HTTP status code is not handled or not allowed
2026-01-10 20:36:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/front-guard-48-exhaust-fans>: HTTP status code is not handled or not allowed
2026-01-10 20:36:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-molded-ring-binder-side-open-medium-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:36:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-step-aluminum-rolling-ladder-24w-ribbed-tread-21d-top-step>: HTTP status code is not handled or not allowed
2026-01-10 20:36:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-x-40-roll-ultimat-rubber-dark-blue-ur-4840db>: HTTP status code is not handled or not allowed
2026-01-10 20:36:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forklift-container-ramp-72in-w-x-84in-l-20-000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:36:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forklift-container-ramp-60in-w-x-60in-l-20-000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:36:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-tefc-aluminum-propeller-fan-w-high-stand-3-phase-1-hp>: HTTP status code is not handled or not allowed
2026-01-10 20:36:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/unsupported-8-step-40-cantilever-ladder-serrated>: HTTP status code is not handled or not allowed
2026-01-10 20:36:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/Polypropylene-Machine-Grade>: HTTP status code is not handled or not allowed
2026-01-10 20:36:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1851-se-53-4-76mm-x-7-1mm-double-cut-egg-shaped-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-tefc-aluminum-propeller-fan-w-low-stand-3-phase-5-hp-1>: HTTP status code is not handled or not allowed
2026-01-10 20:36:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60x36-plastic-safety-edge-mobile-power-apron-lab-bench-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:36:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ovocontrol-p-pigeon-birth-control-tripod-feeder-ov-pg12>: HTTP status code is not handled or not allowed
2026-01-10 20:36:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dura-spike-narrow-w-bond-bird-spikes-102-ft-bp-sr200>: HTTP status code is not handled or not allowed
2026-01-10 20:36:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1852-sl-3l6-3-8-x-1-4-double-cut-included-angle-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-jacket-blue-compound-gauge-r-22-r-404a-r-410a-3-18>: HTTP status code is not handled or not allowed
2026-01-10 20:36:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cle-line-1852-sl-6-5-8-x-1-4-standard-cut-included-angle-bur>: HTTP status code is not handled or not allowed
2026-01-10 20:36:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pop-up-ball-transfer-platform-19-w-x-32-l>: HTTP status code is not handled or not allowed
2026-01-10 20:36:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-black-stealthnet-standard-duty-bird-netting-25-x-25-n1-b110>: HTTP status code is not handled or not allowed
2026-01-10 20:36:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hinged-design-tilter>: HTTP status code is not handled or not allowed
2026-01-10 20:36:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eagle-eye-pro-peller-wind-powered-bird-deterrent-kit-red-ee-ppr>: HTTP status code is not handled or not allowed
2026-01-10 20:36:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/statshield-metal-in-bag-4in-x-24in-100-bagspack>: HTTP status code is not handled or not allowed
2026-01-10 20:36:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-jacket-hose-60-38-hose-plus-iiyellow-38>: HTTP status code is not handled or not allowed
2026-01-10 20:36:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bottle-wide-mouth-hdpe-bottle-attached-polypropylene-screw-cap-amber-2-liters-05-gallons>: HTTP status code is not handled or not allowed
2026-01-10 20:36:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-jacket-heat-pump-manifold-no-hose>: HTTP status code is not handled or not allowed
2026-01-10 20:36:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forged-steel-forks-1-75-thick-48-l>: HTTP status code is not handled or not allowed
2026-01-10 20:36:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-1-4-x-65-1-2-h-deluxe-office-partition-with-pass-thru-cable-gray-277550gy>: HTTP status code is not handled or not allowed
2026-01-10 20:36:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cep-6415-50-feet-10-gauge-4-conductor-sow-rubber-extension-cord-30-amps-125-250-volts-nema-l14-30p-to-l14-30r>: HTTP status code is not handled or not allowed
2026-01-10 20:36:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inoculation-loop-rigid-1ul-with-needle-w-calibration-certificate-sterile-blue-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:36:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wl069-ezkneelerkneeboard-24-x-14>: HTTP status code is not handled or not allowed
2026-01-10 20:36:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/packout-large-tool-box>: HTTP status code is not handled or not allowed
2026-01-10 20:37:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truck-semi-trailer-bumper-3-5-w-x-6-l-x-3-5-h>: HTTP status code is not handled or not allowed
2026-01-10 20:37:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-sport-electronic-earmuff-1030942>: HTTP status code is not handled or not allowed
2026-01-10 20:37:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-wire-adjustable-wrist-strap-w-7-mm-snaps-6ft-coil-cord>: HTTP status code is not handled or not allowed
2026-01-10 20:37:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jewel-premium-metal-dual-wire-wrist-strap-w-4-mm-snaps-medium>: HTTP status code is not handled or not allowed
2026-01-10 20:37:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/270l075-standard-timing-belt-l-3-4-x-27-t72-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 20:37:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-1-4-x-65-1-2-h-deluxe-office-partition-panel-with-pass-thru-cable-blue-277559bl>: HTTP status code is not handled or not allowed
2026-01-10 20:37:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supco-pressure-switch-25-psi-open-50-psi-closed>: HTTP status code is not handled or not allowed
2026-01-10 20:37:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supco-pressure-switch-90-psi-open-120-psi-closed>: HTTP status code is not handled or not allowed
2026-01-10 20:37:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/210l037-standard-timing-belt-l-3-8-x-21-t56-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 20:37:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/71-x-24-inch-heavy-duty-adjustable-height-steel-work-platform-orange-9-h-to-14-h>: HTTP status code is not handled or not allowed
2026-01-10 20:37:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-x-24-inch-heavy-duty-adjustable-height-steel-work-platform-orange-5-h-to-8-h>: HTTP status code is not handled or not allowed
2026-01-10 20:37:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beaker-pmp-tpx-printed-graduations-25ml-20-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supco-fin-comb-111213-fins-per-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:37:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dissipative-dual-layer-rubber-roll-light-blue-0060in-x-30in-x-50ft>: HTTP status code is not handled or not allowed
2026-01-10 20:37:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/405l100-standard-timing-belt-l-1-x-40-1-2-t108-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 20:37:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20624 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:37:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gp250-usb-digital-bench-scale-with-usb-port-250-x-0-5-lb-12-1-2-x-11-platform>: HTTP status code is not handled or not allowed
2026-01-10 20:37:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supco-gem-ig104-replacement-hot-surface-igniter>: HTTP status code is not handled or not allowed
2026-01-10 20:37:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teller-pedestal-cabinet-s-213-a-6-drawers-2-legal-drawers-37w-x-19d-x-38-1-2h-champagne>: HTTP status code is not handled or not allowed
2026-01-10 20:37:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/furniture-pipe-thinwall-fittings-5l-1dia-furniture-grade-pvc-white>: HTTP status code is not handled or not allowed
2026-01-10 20:37:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lowboy-teller-pedestal-cabinet-s-604l-b-2-drawers-left-hinged-door-19-x-19-x-27-7-8-black>: HTTP status code is not handled or not allowed
2026-01-10 20:37:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graduated-cylinder-polypropylene-molded-graduations-50ml-30-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supco-freeze-protection-control>: HTTP status code is not handled or not allowed
2026-01-10 20:37:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ice-tray-with-lid-9-liter-red>: HTTP status code is not handled or not allowed
2026-01-10 20:37:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motorized-hand-truck-pneumatic-tires-and-tent-pole-pusher-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:37:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vornado-660-large-whole-room-air-circulator>: HTTP status code is not handled or not allowed
2026-01-10 20:37:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cd255x370-oval-dual-run-capacitor-25-5-mfd-x-370v>: HTTP status code is not handled or not allowed
2026-01-10 20:37:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/temperature-test-chamber-single-glass-door-23-cu-ft-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:37:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/temperature-test-chamber-double-glass-door-49-cu-ft-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:37:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-frame-guard-le>: HTTP status code is not handled or not allowed
2026-01-10 20:37:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/axion-msr-combination-eye-face-wash-drench-shower-8300crp-8309crp>: HTTP status code is not handled or not allowed
2026-01-10 20:37:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extra-work-table-w-2-shelves-72-w-x-28-d-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:37:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/420h300-standard-timing-belt-h-3-x-42-t84-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 20:37:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-inch-round-bistro-table-4-barstool-set-designer-white-table-top-with-espresso-barstools>: HTTP status code is not handled or not allowed
2026-01-10 20:37:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-boltless-shelving-48-w-x-48-d-x-84-h-3-level-starter-no-deck-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:37:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2120h100-standard-timing-belt-h-1-x-212-t424-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 20:37:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2010h100-standard-timing-belt-h-1-x-201-t402-trapezoidal>: HTTP status code is not handled or not allowed
2026-01-10 20:37:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-rivet-angle-beam-60-w-x-24-d-x-84-h-4-level-starter-no-deck-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:37:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wet-zone-store-board-accu-shield-fb-x-red-on-black>: HTTP status code is not handled or not allowed
2026-01-10 20:37:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/economy-cutter-36-cut-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:37:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cap-insert-for-new-cryoclear-vials-yellow-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40bs53x118-12-pitch-1-18-finished-bore-53-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:37:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-120bs09hx1-1-12-pitch-1-finished-bore-9-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:37:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs17hx1316-1-pitch-1-316-finished-bore-17-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:37:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camcruiser-vending-cart-4-full-size-pans-6-deep-hot-red>: HTTP status code is not handled or not allowed
2026-01-10 20:37:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ha018240-home-advantage-ii-electric-tankless-water-heater-18-kw-75a>: HTTP status code is not handled or not allowed
2026-01-10 20:37:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-oil-only-booms-4-case-20-x-8>: HTTP status code is not handled or not allowed
2026-01-10 20:37:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-twoline-guardrail-steel-hdpe-plastic-yellow-120-x-42>: HTTP status code is not handled or not allowed
2026-01-10 20:37:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/folding-security-gate-6-6-hx12-w-use>: HTTP status code is not handled or not allowed
2026-01-10 20:37:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-spunbond-oil-only-heavy-weight-pads-100-bale-18-x-15>: HTTP status code is not handled or not allowed
2026-01-10 20:37:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs15hx1-1-pitch-1-finished-bore-15-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:37:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gray-spunbond-fine-fiber-universal-heavy-weight-pads-100-bale-18-x-15>: HTTP status code is not handled or not allowed
2026-01-10 20:37:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-hazmat-pillows-10-case-18-x-18>: HTTP status code is not handled or not allowed
2026-01-10 20:37:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/funnel-powder-polypropylene-80mm-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beaker-diamond-essentials-griffin-style-low-form-printed-graduations-pmp-250ml-6-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-25a60x12-a-plate-14-pitch-12-bore-60-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:37:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bottle-with-screwcap-wide-mouth-ldpe-graduated-50ml-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pyramid-sign-base-with-98h-post-blue-22w-x-22d-x-22h-base>: HTTP status code is not handled or not allowed
2026-01-10 20:37:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72w-x-30d-modular-workbench-with-3-drawers-shop-top-safety-edge-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:37:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-tect-runner-174-protection-36in-w-x-150ft-l-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:37:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-120btl13h-taper-bushed-1-12-pitch-13-teeth-13-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:37:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72w-x-30d-modular-workbench-with-5-drawers-shop-top-safety-edge-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:37:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cleanmax-pro-series-upright-vacuum-with-quick-draw-tools-14-cleaning-width-green>: HTTP status code is not handled or not allowed
2026-01-10 20:37:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bottle-with-screwcap-wide-mouth-ldpe-graduated-500ml-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beaker-polypropylene-molded-graduations-50ml-20-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protective-window-film-12in-w-x-500ft-l-4-mil>: HTTP status code is not handled or not allowed
2026-01-10 20:37:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twin-size-fitted-bed-sheets-80-inch-x-36-inch-x-7-inch-white-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/securall-312x96x100-agri-chemical-building>: HTTP status code is not handled or not allowed
2026-01-10 20:37:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7093-particulate-filter-p100-12-box>: HTTP status code is not handled or not allowed
2026-01-10 20:37:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/blue-center-stripe-towel-48-inch-x-24-inch-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tune-up-kit-for-mfr-no-3955-series>: HTTP status code is not handled or not allowed
2026-01-10 20:37:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs34hx1-58-pitch-1-finished-bore-34-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:37:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/active-air-mgmp1-2-way-moistureph-meter>: HTTP status code is not handled or not allowed
2026-01-10 20:37:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/active-air-mgmlp1-3-way-meter-test-moisture-light-and-ph-levels>: HTTP status code is not handled or not allowed
2026-01-10 20:37:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ice-caddies-beige-175-lbs-cap-tall-2-fixed-2-swivel-1-with-brake>: HTTP status code is not handled or not allowed
2026-01-10 20:37:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs23hx1716-34-pitch-1-716-finished-bore-23-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:37:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/impact-wrench-accessory-tool-boot>: HTTP status code is not handled or not allowed
2026-01-10 20:37:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thermal-leno-weave-blankets-twin-size-white-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/spa-and-comfort-bath-towel-50-inch-x-27-inch-white-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-direct-drive-blower-motor-460-volts-1100-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:37:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-5-5-8-split-capacitor-condenser-fan-motor-208-230-volts-1075-rpm-7>: HTTP status code is not handled or not allowed
2026-01-10 20:37:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-shelf-computer-lanstation-workstation-63-hx24-wx36-l-black-4-shelf>: HTTP status code is not handled or not allowed
2026-01-10 20:37:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-single-phase-jet-pump-motor-115-230-volts-3450-rpm-1-2hp-1>: HTTP status code is not handled or not allowed
2026-01-10 20:37:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/securall-primer-coat-saltwater-agb900>: HTTP status code is not handled or not allowed
2026-01-10 20:37:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3775l-squids-174-large-can-bottle-holder-trap-black>: HTTP status code is not handled or not allowed
2026-01-10 20:37:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-vis-nylon-pants-welastic-waist-ansi-class-e-30l-l-limeblack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-visibility-rain-jacket-ansi-class-3-l-yellowblack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metal-detectable-dispenser-corded-33db-150-pairs>: HTTP status code is not handled or not allowed
2026-01-10 20:37:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-5-5-8-split-capacitor-condenser-fan-motor-460-volts-1075-rpm-3>: HTTP status code is not handled or not allowed
2026-01-10 20:37:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hygiene-kit-for-mx-6-mx-7-earmuffs>: HTTP status code is not handled or not allowed
2026-01-10 20:37:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-unit-heater-motor-115-volts-1075-rpm-1-4hp-2>: HTTP status code is not handled or not allowed
2026-01-10 20:37:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6667-chill-its-174-wet-evaporative-cooling-vest-pva-blue-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:37:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9003-proflex-174-certified-lightweight-anti-vibration-gloves-black-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:37:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/groz-44133-vertical-lift-safety-pump-5-gallon-pail>: HTTP status code is not handled or not allowed
2026-01-10 20:37:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-pallet-covers-41-x-31-x-72-2-mil-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-chipboard-pads-9-x-12-x-0030-640-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:37:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-care-20-x25-x1-electrostatic-air-filter-merv-8>: HTTP status code is not handled or not allowed
2026-01-10 20:37:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-care-20-x20-x1-electrostatic-air-filter-merv-8>: HTTP status code is not handled or not allowed
2026-01-10 20:37:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35a17hx12-a-plate-38-pitch-12-bore-17-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:37:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-5-5-8-permanent-split-capacitor-motor-208-230-volts-1075-rpm-13>: HTTP status code is not handled or not allowed
2026-01-10 20:38:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-panel-face-envelopes-packing-list-enclosed-5-1-2-wx10-l-orange-1000-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:38:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medication-station-aspirin-ibuprofen-non-aspirin-pain-reliever-antacid>: HTTP status code is not handled or not allowed
2026-01-10 20:38:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-care-16-x16-x1-electrostatic-air-filter-merv-8>: HTTP status code is not handled or not allowed
2026-01-10 20:38:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/armor-poly-vci-bags-4-mil-13-x-11-x-25-blue-250-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:38:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/25a-battery-charger>: HTTP status code is not handled or not allowed
2026-01-10 20:38:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-multi-stream-recycling-can-25-gallon-total-satin-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:38:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-pallet-covers-52-x-48-x-60-3-mil-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graduated-cylinder-polypropylene-molded-graduations-25ml-30-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-pallet-covers-68-x-65-x-87-3-mil-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/red-current-calender-year-2-dia-fluorescent-red-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-5-5-8-condenser-fan-motor-208-230-volts-825-rpm-1>: HTTP status code is not handled or not allowed
2026-01-10 20:38:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inoculation-loop-flexible-10ul-calibration-certificate-sterile-polystyrene-yellow-pp-250-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:38:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-green-discs-1-1-2-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:38:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-4-packing-slip-inside-white-red>: HTTP status code is not handled or not allowed
2026-01-10 20:38:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inspect-for-damage-before-accepting-3-5-fluorescent-red-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20723 pages (at 99 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:38:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/a-o-smith-5-5-8-heatmaster-motor-208-230-volts-825-rpm-3>: HTTP status code is not handled or not allowed
2026-01-10 20:38:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-3-3-shaded-pole-dra-inducer-motor-115-volts-3000-rpm-7>: HTTP status code is not handled or not allowed
2026-01-10 20:38:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-3-3-shaded-pole-open-motor-460-volts-1500-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:38:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stinger-1-1-2-ton-motorcyle-atv-lift>: HTTP status code is not handled or not allowed
2026-01-10 20:38:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/charger-6-12v-70-62-2a-agm-265-amp-cranking>: HTTP status code is not handled or not allowed
2026-01-10 20:38:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/number-8-adjustable-height-economy-packing-workbench-laminate-safety-edge-72-x-36-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:38:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs24hx1-34-pitch-1-finished-bore-24-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-3-3-shaded-pole-self-cooled-motor-115-230-volts-3000-rpm-3>: HTTP status code is not handled or not allowed
2026-01-10 20:38:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-bags-4-x-6-2-mil-black-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screw-cap-for-microtube-with-o-ring-white-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scrap-by-1-3-8-2-fluorescent-red-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/02ml-8-strip-flat-caps-no-tubes-optically-clear-for-qpcr-125-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shrink-bags-24-x-24-x-100-gauge-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-gauge-25-ft-600-amp-parrot-clamp-professional-booster-cables>: HTTP status code is not handled or not allowed
2026-01-10 20:38:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-3-3-shaded-pole-totally-enclosed-motor-115-volts-1500-rpm-6>: HTTP status code is not handled or not allowed
2026-01-10 20:38:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-10bs25hx32-metric-58-pitch-32mm-finished-bore-25-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100-amp-6-12v-battery-starter-charging-tester>: HTTP status code is not handled or not allowed
2026-01-10 20:38:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jun-2-fluorescent-red-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-4-4-shaded-pole-motor-115-230-volts-1550-rpm-1>: HTTP status code is not handled or not allowed
2026-01-10 20:38:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ibg-12ssb-12-inch-single-speed-industrial-buffer>: HTTP status code is not handled or not allowed
2026-01-10 20:38:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eclipse-detachable-hood-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:38:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7pc-hose-kit-for-industrial-bench-grinders-belt-sanders-bench-belt-disc-grinders>: HTTP status code is not handled or not allowed
2026-01-10 20:38:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/right-to-know-hazard-2-2-white-red-black-blue-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:38:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-ge-21-29-frame-replacement-motor-115-208-230-volts-1550-rpm-6>: HTTP status code is not handled or not allowed
2026-01-10 20:38:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-parts-enclosed-3-5-fluorescent-green-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-tier-1-door-premium-steel-locker-12-w-x-12-d-x-72-h-light-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:38:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hazard-class-2-non-flammable-gas-4-4-green-white>: HTTP status code is not handled or not allowed
2026-01-10 20:38:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flite-safety-toe-work-shoe-black-size-7>: HTTP status code is not handled or not allowed
2026-01-10 20:38:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/professional-40lb-hand-crank-broadcast-spreader>: HTTP status code is not handled or not allowed
2026-01-10 20:38:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-3-3-shaded-pole-open-motor-115-volts-1500-rpm-15>: HTTP status code is not handled or not allowed
2026-01-10 20:38:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hazard-class-4-flammable-solid-4-4-white-red-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/to-go-rack-chrome-18w-x-30l-x-34h-3-wire-shelves-dividers-ledges>: HTTP status code is not handled or not allowed
2026-01-10 20:38:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-reflective-plastic-barrier-chain-2-x-100-ft-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-mobile-computer-cabinet-27-w-x-24-d-x-49-1-2-h-dark-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:38:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fragile-w-arrows-4-6-white-red-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-41a60x34-a-plate-12-pitch-34-bore-60-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contractor-grade-high-adhesion-masking-tape-natural-48mm-x-55m-pack-of-24>: HTTP status code is not handled or not allowed
2026-01-10 20:38:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/do-not-break-bilingual-3-5-fluorescent-red-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60btl23h-taper-bushed-34-pitch-23-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-reflective-plastic-barrier-chain-2-x-100-ft-evergreen>: HTTP status code is not handled or not allowed
2026-01-10 20:38:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-caution-label-stanchion-and-chain-kit-40-height-and-50-of-2-chain>: HTTP status code is not handled or not allowed
2026-01-10 20:38:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-41bs40x1316-12-pitch-1-316-finished-bore-40-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-polypropylene-camlock-fitting-female-coupler-x-mpt-thread>: HTTP status code is not handled or not allowed
2026-01-10 20:38:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-aluminum-camlock-fitting-female-coupler-x-fpt-thread>: HTTP status code is not handled or not allowed
2026-01-10 20:38:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-aluminum-camlock-fitting-female-coupler-x-fpt-thread>: HTTP status code is not handled or not allowed
2026-01-10 20:38:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-16bs14hx50-metric-1-pitch-50mm-finished-bore-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40bs34hx112-12-pitch-1-12-finished-bore-34-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mr-chain-2-heavy-duty-master-link-traffic-blue-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:38:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rb314-women-s-athletic-work-shoe-teal-black-size-8-w>: HTTP status code is not handled or not allowed
2026-01-10 20:38:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hazard-class-7-radioactive-i-4-4-white-red-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50b24hx34mpb-58-pitch-34-plain-bore-24-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/trash-2-3-red-white>: HTTP status code is not handled or not allowed
2026-01-10 20:38:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-3-3-shaded-pole-dra-inducer-blower-115-volts-3200-rpm-3>: HTTP status code is not handled or not allowed
2026-01-10 20:38:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-3-3-shaded-pole-dra-inducer-blower-208-230-volts-3200-rpm-1>: HTTP status code is not handled or not allowed
2026-01-10 20:38:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-3-new-designed-lightweight-shirt-rip-stop-bottom-down-shirt-w-spf-50-lime-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:38:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-class-2-mesh-zipper-safety-vest-lime-4xl-5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:38:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curbside-cart-chrome-24w-x-48l-x-43h-2-wire-1-solid-shelf-pneumatic-2-rigid-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:38:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-2-lady-short-sleeve-t-shirt-lime-with-pink-side-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:38:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-multi-color-vest-black-l-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:38:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-20bs14hx32-metric-1-14-pitch-32mm-finished-bore-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wired-ptac-thermostat-non-programmable-2h-1c-or-1h-1c>: HTTP status code is not handled or not allowed
2026-01-10 20:38:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-multi-color-vest-purple-s-m>: HTTP status code is not handled or not allowed
2026-01-10 20:38:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curbside-truck-silver-ep-18w-x-24l-x-72h-4-wire-shelves-pneumatic-2-rigid-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:38:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs34x112-34-pitch-1-12-finished-bore-34-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stationary-tip-out-bin-unit-single-sided-48-h-white>: HTTP status code is not handled or not allowed
2026-01-10 20:38:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dont-break-stretch-wrap-3-10-fluorescent-red-black>: HTTP status code is not handled or not allowed
2026-01-10 20:38:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-slotted-pallet-rack-add-on-no-deck-96-inches-w-x-42-inches-d-x-144-inches-h>: HTTP status code is not handled or not allowed
2026-01-10 20:38:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/origami-5-tier-large-heavy-duty-rack-78-w-x-36-w-x-21-h-platinum>: HTTP status code is not handled or not allowed
2026-01-10 20:38:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-inch-slantwall-exhaust-fan-belt-drive-1-hp-16780-cfm-115-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:38:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mantis-2x2-commercial-fly-light-white>: HTTP status code is not handled or not allowed
2026-01-10 20:38:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chameleon-1x2-ip66-220-volt-special-order>: HTTP status code is not handled or not allowed
2026-01-10 20:38:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/airtight-container-pp-full-size-2-5-8-5qt-translucent-pp-lid-included>: HTTP status code is not handled or not allowed
2026-01-10 20:38:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caution-this-side-up-3-5-red-white>: HTTP status code is not handled or not allowed
2026-01-10 20:38:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/655-1-4-fnpt-brass-tee-hose-fitting>: HTTP status code is not handled or not allowed
2026-01-10 20:38:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/demi-diamond-fruit-fly-sticky-trap-combo-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-drawer-mobile-cabinet-48-wx24-dx37-1-2-h-everest-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:38:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-led-flat-panel-w-tunable-color-lumens-25w-to-40w>: HTTP status code is not handled or not allowed
2026-01-10 20:38:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunburst-glue-boards-transluscent-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chameleon-exg-glue-board-gray-6-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:38:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs24x2316-1-pitch-2-316-finished-bore-24-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-drawer-mobile-cabinet-24-wx21-dx35-1-4-h-avalanche-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:38:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs12hx25-metric-1-12-pitch-25mm-finished-bore-12-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:38:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-drawer-mobile-cabinet-30-wx21-dx37-1-2-h-light-gray-2>: HTTP status code is not handled or not allowed
2026-01-10 20:38:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-680-30-1-4-id-snubber-hose>: HTTP status code is not handled or not allowed
2026-01-10 20:39:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/puller-dent-hammer-slide-81400>: HTTP status code is not handled or not allowed
2026-01-10 20:39:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nabisco-chips-ahoy-cookies-3-4-lb-gr>: HTTP status code is not handled or not allowed
2026-01-10 20:39:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rx-19-drawer-roller-cabinet-55-w-x-25-d-x-h-46-orange-w-black-handles-trim>: HTTP status code is not handled or not allowed
2026-01-10 20:39:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/between-series-nested-multipurpose-table-72-l-x-30-w-x-29-h-shaker-cherry>: HTTP status code is not handled or not allowed
2026-01-10 20:39:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-drawer-mobile-multi-drawer-cabinet-60-wx27-dx37-1-2-h-beige-1>: HTTP status code is not handled or not allowed
2026-01-10 20:39:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/capri-sun-100-juice-variety-pack-40-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 20:39:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-wd12aa2pz7-1-2-hp-1-phase-1700-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-wd13aa2pz7-1-3-hp-1-phase-1700-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/offset-style-decal-eraser-wheel-df-705d>: HTTP status code is not handled or not allowed
2026-01-10 20:39:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-reflective-delineator-post-with-hexagonal-base-45-height-white>: HTTP status code is not handled or not allowed
2026-01-10 20:39:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stevia-in-the-raw-zero-calorie-sweetener-800-packets-gr>: HTTP status code is not handled or not allowed
2026-01-10 20:39:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jif-to-go-peanut-butter-dipping-cups-36-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 20:39:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mesh-back-office-chair-with-lumbar-support-fabric-seat-black>: HTTP status code is not handled or not allowed
2026-01-10 20:39:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-step-24-w-aluminum-tilt-roll-ladder-ribbed-tread>: HTTP status code is not handled or not allowed
2026-01-10 20:39:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-ec13-2-hp-1-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20822 pages (at 99 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:39:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-stock-picking-truck-24-60-63-single-sided-25-cells-10-w>: HTTP status code is not handled or not allowed
2026-01-10 20:39:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/antimicrobial-round-reception-ottoman-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:39:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-1861h-1-3-hp-1-phase-1075-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-panel-mobile-medical-privacy-screen-81-wx69-h-green-vinyl-panels>: HTTP status code is not handled or not allowed
2026-01-10 20:39:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ghirardelli-chocolate-intense-dark-sea-salt-soiree-4-12-oz-3-pack-gr>: HTTP status code is not handled or not allowed
2026-01-10 20:39:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-paper-recycling-lid-green>: HTTP status code is not handled or not allowed
2026-01-10 20:39:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-coffee-creamer-salted-caramel-chocolate-0-38-oz-mini-cups-50-box>: HTTP status code is not handled or not allowed
2026-01-10 20:39:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wellsley-farms-chewy-chocolate-chip-granola-bars-88-oz-60-count-gr>: HTTP status code is not handled or not allowed
2026-01-10 20:39:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-t12cm2j-1-2-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-step-24-w-stainless-steel-ladder-without-rails-perforated-tread>: HTTP status code is not handled or not allowed
2026-01-10 20:39:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/abt-hc-afs-1720-standard-auto-defrost-hydrocarbon-laboratory-freezer-17-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:39:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-poly-z-brite-4-tier-microwave-station-cart-kit-24-l-x-18-w-x-63-h>: HTTP status code is not handled or not allowed
2026-01-10 20:39:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-t2c1jh-2-hp-1-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-t13c2j-1-3-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-1879-3-4-hp-1-phase-1075-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lateral-38-3-drawer-fire-and-water-resistant-file-cabinet-putty-lat3w38p>: HTTP status code is not handled or not allowed
2026-01-10 20:39:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexvolt-60v-max-brushless-7-1-4-inch-cordless-circular-saw-with-brake-kit-2-batteries-dcs578x2>: HTTP status code is not handled or not allowed
2026-01-10 20:39:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-max-brushless-cordless-reciprocating-saw-with-flexvolt-advantage-bare-tool-only-dcs386b>: HTTP status code is not handled or not allowed
2026-01-10 20:39:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-wds32s2acr-1-5-hp-3-phase-1755-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-inch-high-capacity-wet-tile-saw-d36000>: HTTP status code is not handled or not allowed
2026-01-10 20:39:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-1-4-inch-compact-jobsite-table-saw-dwe7485>: HTTP status code is not handled or not allowed
2026-01-10 20:39:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-eb126-1-2-hp-1-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zcm1000p138-3pk-smooth-separating-roller-ring-for-zcm1000-dispensers-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:39:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-eh704-2-hp-3-phase-3450-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-2249-1-8-hp-1-phase-1075-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ada-barrier-free-cooler-stainless-steel-wall-hung-115v-60hz-5-amps>: HTTP status code is not handled or not allowed
2026-01-10 20:39:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubbermaid-square-recycling-container-50-gallon-1>: HTTP status code is not handled or not allowed
2026-01-10 20:39:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-4-inch-round-switchable-retrofit-downlight-e-series-2700k-5000k-white>: HTTP status code is not handled or not allowed
2026-01-10 20:39:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-d14b2nza9-1-4-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn77-50-1-h-184tc-cast-iron-helical-bevel-speed-reducer-184tc-input-flange-50-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 20:39:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u3e2dc-3-hp-3-phase-1765-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn67-40-1-h-56c-cast-iron-helical-bevel-speed-reducer-56c-input-flange-40-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 20:39:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-side-pump-bottle-jack-30-ton>: HTTP status code is not handled or not allowed
2026-01-10 20:39:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-workbench-w-leg-5-drawer-cabinet-plastic-laminate-top-blue-3>: HTTP status code is not handled or not allowed
2026-01-10 20:39:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-actuated-long-chassis-hydraulic-service-jack-10-ton>: HTTP status code is not handled or not allowed
2026-01-10 20:39:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/workbench-plastic-laminate-adjustable-riser-shelf-with-back-stop-blue-2>: HTTP status code is not handled or not allowed
2026-01-10 20:39:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-10-drawer-standard-cabinet-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:39:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lista-9-drawer-shallow-depth-cabinet-blue-2>: HTTP status code is not handled or not allowed
2026-01-10 20:39:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u7p1g-7-5-hp-3-phase-3510-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn97-10-1-h-254-6tc-cast-iron-helical-bevel-speed-reducer-254-6tc-input-flange-10-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 20:39:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn67-30-1-h-145tc-cast-iron-helical-bevel-speed-reducer-145tc-input-flange-30-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 20:39:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/khn-helical-bevel-reducer-double-shaft-kit-shaft-dia-2-75-l-23-54-5-51-usable-hardw-incl>: HTTP status code is not handled or not allowed
2026-01-10 20:39:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/khn-helical-bevel-reducer-single-shaft-kit-shaft-dia-2-75-l-17-597-5-51-usable-hardw-incl>: HTTP status code is not handled or not allowed
2026-01-10 20:39:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn37-10-1-h-143-5tc-cast-iron-helical-bevel-speed-reducer-143-5tc-input-flange-10-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 20:39:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn67-120-1-h-56c-cast-iron-helical-bevel-speed-reducer-56c-input-flange-120-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 20:39:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-ee612-2-hp-3-phase-3510-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-khn67-20-1-h-182-4tc-cast-iron-helical-bevel-speed-reducer-182-4tc-input-flange-20-1-foot-mt>: HTTP status code is not handled or not allowed
2026-01-10 20:39:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-agl10fl2s-1-1-8-hp-1-phase-3450-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powr-flite-pfms-nebula-disinfectant-mister-detail-cleaner-3-5-gal-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:39:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u10p1h-10-hp-3-phase-3520-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vp40n12-vacuum-packer-40cm-sealing-bar>: HTTP status code is not handled or not allowed
2026-01-10 20:39:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-welded-double-point-ventilated-locker-double-tier-3-wide-18x18x72>: HTTP status code is not handled or not allowed
2026-01-10 20:39:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floor-supported-personal-safety-workbench-partition-60w-x-60h-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:39:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-u2p1d-2-hp-3-phase-3505-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hallowell-ready-built-ii-locker-triple-tier-3-wide-12x18x78-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:39:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-yard-front-loading-dumpster-with-bumpers-dark-cool-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:39:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-retardant-step-on-container-23-gallon-white>: HTTP status code is not handled or not allowed
2026-01-10 20:39:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-rivet-steel-shelving-with-wood-deck-84-w-x-30-d-x-96-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:39:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-rivet-steel-shelving-with-wood-deck-48-w-x-24-d-x-84-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:39:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steady-burn-light-24vdc-clear-lp2-024c>: HTTP status code is not handled or not allowed
2026-01-10 20:39:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microstat-2-high-120vac-amber-green-msl2-120ag>: HTTP status code is not handled or not allowed
2026-01-10 20:39:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-yc2p3b-2-hp-3-phase-1175-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lau-3-blade-condenser-propeller-16-diameter-ccw-rotation-1>: HTTP status code is not handled or not allowed
2026-01-10 20:39:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-galvanized-steel-blower-wheel-6-diameter-1-2-bore-2>: HTTP status code is not handled or not allowed
2026-01-10 20:39:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-master-link-2-inch-link-safety-orange-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:39:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-heavy-duty-plastic-chain-120-feet-in-a-pail-white>: HTTP status code is not handled or not allowed
2026-01-10 20:39:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fasco-galvanized-steel-blower-wheel-8-5-64-diameter-1-2-bore-1>: HTTP status code is not handled or not allowed
2026-01-10 20:39:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-un5t2bc-5-hp-3-phase-1770-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lau-4-blade-condenser-propeller-14-diameter-ccw-rotation-3>: HTTP status code is not handled or not allowed
2026-01-10 20:39:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-yc5p2b-5-hp-3-phase-1755-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-master-link-1-5-inch-link-safety-orange-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:39:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-d3p2h-3-hp-3-phase-1770-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lau-4-blade-condenser-propeller-10-diameter-cw-rotation-3>: HTTP status code is not handled or not allowed
2026-01-10 20:39:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-d5p2h-5-hp-3-phase-1760-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-c2p1b-2-hp-3-phase-3495-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-galvanized-steel-narrow-aisle-platform-truck-60-x-24-1750-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:39:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wesco-folding-aluminum-narrow-aisle-platform-truck-1750-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:39:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-set-screw-stainless-steel-assortment-375-piece>: HTTP status code is not handled or not allowed
2026-01-10 20:39:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-1696-3-4-hp-1-phase-1625-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:39:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-kit-camshelving-18x36-solid-shelves>: HTTP status code is not handled or not allowed
2026-01-10 20:39:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-stationary-starter-5-vented-shelves-18x54x64>: HTTP status code is not handled or not allowed
2026-01-10 20:39:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-stationary-starter-5-vented-shelves-21x36x64>: HTTP status code is not handled or not allowed
2026-01-10 20:40:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/252940-swivel-sign-holder-4-x-6>: HTTP status code is not handled or not allowed
2026-01-10 20:40:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-prong-tool-wrench-holder>: HTTP status code is not handled or not allowed
2026-01-10 20:40:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-3255-1-12-hp-1-phase-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:40:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wwe-kan77-50-1-h-184tc-cast-iron-helical-bevel-speed-reducer-184tc-input-flange-50-1>: HTTP status code is not handled or not allowed
2026-01-10 20:40:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-8052-1-3-hp-1-phase-825-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:40:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-pegboard-mobile-tool-cart>: HTTP status code is not handled or not allowed
2026-01-10 20:40:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/us-motor-5108-1-3-hp-1-phase-1100-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:40:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-ring-stem-so-tread-caster-with-brake-75mm-dia-7-16-x-1-7-16-stem-black>: HTTP status code is not handled or not allowed
2026-01-10 20:40:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camwear-colander-6-15-16-x-12-3-4-x-5-deep-clear-polycarbonate-fits-1-3-size-food-pans-nsf>: HTTP status code is not handled or not allowed
2026-01-10 20:40:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/threaded-stem-so-tread-caster-75mm-dia-3-8-16-x-1-stem-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:40:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camcarrier-food-pan-carrier-for-12x20-food-pans-16-1-2x24x23-5-16-approx-cap-36-qts-black-nsf>: HTTP status code is not handled or not allowed
2026-01-10 20:40:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camtherm-hot-tall-profile-celsius-granite-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:40:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-lid-for-parsley-shaker-dredge-white>: HTTP status code is not handled or not allowed
2026-01-10 20:40:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-partition-panel-with-window-gray-36-1-4-w-x-96-h>: HTTP status code is not handled or not allowed
2026-01-10 20:40:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camwear-drain-shelf-fits-32cw-34cw-36cw-and-38cw-clear-polycarbonate-nsf>: HTTP status code is not handled or not allowed
2026-01-10 20:40:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dogipot-litter-bag-dispenser-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:40:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 20920 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:40:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-deluxe-freestanding-office-partition-panel-48-1-4-w-x-96-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:40:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-desk-cherry-2>: HTTP status code is not handled or not allowed
2026-01-10 20:40:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-deluxe-freestanding-office-partition-panel-60-1-4-w-x-96-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:40:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/octagonal-message-board>: HTTP status code is not handled or not allowed
2026-01-10 20:40:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interion-deluxe-mobile-office-partition-panel-48-1-4-w-x-96-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:40:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/afs49ml-pharma-lab-performance-series-upright-pharmacy-freezer-solid-doors-49-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:40:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arg6pv-pharma-vac-performance-series-ada-height-vaccine-refrigerator-glass-door-6-cu-ft>: HTTP status code is not handled or not allowed
2026-01-10 20:40:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/45-0329-175-lb-broadcast-tow-behind-spreader>: HTTP status code is not handled or not allowed
2026-01-10 20:40:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/45-0548-130-lb-commercial-push-broadcast-spreader>: HTTP status code is not handled or not allowed
2026-01-10 20:40:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-hands-free-wall-mount-sink-w-faucet-14-x-10-x-5-deep>: HTTP status code is not handled or not allowed
2026-01-10 20:40:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-upright-two-horizontal-sections>: HTTP status code is not handled or not allowed
2026-01-10 20:40:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deck-mounted-sensor-faucet-with-mixing-valve-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:40:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-desk-tray-sorter-5-shelf>: HTTP status code is not handled or not allowed
2026-01-10 20:40:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/square-food-container-8-quart-translucent>: HTTP status code is not handled or not allowed
2026-01-10 20:40:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-locker-three-tier-1-wide-12-x-15-x-20-deep-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:40:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camtainer-beverage-carrier-insulated-plastic-4-3-4-gallon-16-1-2-d-x-9-w-x-24-1-4-h-green-nsf>: HTTP status code is not handled or not allowed
2026-01-10 20:40:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wall-coat-rack-2-ball-tipped-double-hooks-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:40:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-waste-container-round-recycle-can>: HTTP status code is not handled or not allowed
2026-01-10 20:40:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camwear-food-pan-1-2-size-long-2-1-2-deep-white-nsf>: HTTP status code is not handled or not allowed
2026-01-10 20:40:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hot-cold-cart-tall-profile-granite-sand>: HTTP status code is not handled or not allowed
2026-01-10 20:40:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-panel-for-flat-top-locker-15-x-72-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:40:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-cans-bottles-waste-30-gallon-slate-27-15-30>: HTTP status code is not handled or not allowed
2026-01-10 20:40:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/meal-delivery-cart-tall-profile-1-door-30-5-8x39-1-8x58-1-8-granite-gray-with-cream-color-door>: HTTP status code is not handled or not allowed
2026-01-10 20:40:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/meal-delivery-cart-tall-profile-1-door-30-5-8x39-1-8x58-1-8-granite-sand-with-cream-color-door>: HTTP status code is not handled or not allowed
2026-01-10 20:40:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-headroom-multiple-spread-li-ing-beam-2000-lb-capacity-3-long>: HTTP status code is not handled or not allowed
2026-01-10 20:40:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/union-metal-release-collet-12mm-tube>: HTTP status code is not handled or not allowed
2026-01-10 20:40:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-camcart-food-pan-carrier-front-loading-approximately-cap-90-qt-brick-red>: HTTP status code is not handled or not allowed
2026-01-10 20:40:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camcarrier-ultra-pancarrier-top-loading-approximately-cap-12-qt-stackable-granite-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:40:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-elements-starter-unit-18-w-x-54-l-x-64-h-4-shelf-brushed-graphite>: HTTP status code is not handled or not allowed
2026-01-10 20:40:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/union-tee-composite-6mm-tube-x-4mm-tube-x-6mm-tube>: HTTP status code is not handled or not allowed
2026-01-10 20:40:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/union-tee-composite-4mm>: HTTP status code is not handled or not allowed
2026-01-10 20:40:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camlink-for-dunnage-racks>: HTTP status code is not handled or not allowed
2026-01-10 20:40:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-angle-frame-mirror-24-wx72-h>: HTTP status code is not handled or not allowed
2026-01-10 20:40:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-female-metal-release-collet-8mm-tube-x-1-4-bspp>: HTTP status code is not handled or not allowed
2026-01-10 20:40:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-elements-shelf-plate-kit-18-w-x-36-l-venteded-brushed-graphite>: HTTP status code is not handled or not allowed
2026-01-10 20:40:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-camcart-heated-food-pan-carrier-front-loading-black-6-casters-220v-60-1-ph>: HTTP status code is not handled or not allowed
2026-01-10 20:40:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anemostat-diffuser-5-20kw-downflow-unit-heaters>: HTTP status code is not handled or not allowed
2026-01-10 20:40:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/meal-delivery-cart-low-profile-2-doors-48-1-2x32-1-2x44-granite-sand>: HTTP status code is not handled or not allowed
2026-01-10 20:40:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/camshelving-add-on-unit-18x36x72-brushed-graphite>: HTTP status code is not handled or not allowed
2026-01-10 20:40:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mini-union-elbow-4mm>: HTTP status code is not handled or not allowed
2026-01-10 20:40:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-flat-top-stainless-steel-undershelf-workbench-72-w-x-24-d>: HTTP status code is not handled or not allowed
2026-01-10 20:40:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cast-iron-jaw-coupling-hub-style-l225-2-1-8-inch-bore-diameter-1-2-x-1-4-keyway>: HTTP status code is not handled or not allowed
2026-01-10 20:40:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-male-metal-release-collet-internal-hex-6mm-tube-x-1-8-swift-fit>: HTTP status code is not handled or not allowed
2026-01-10 20:40:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hytrel-jaw-coupling-insert-style-l099-100>: HTTP status code is not handled or not allowed
2026-01-10 20:40:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-male-elbow-metal-release-collet-5-16-tube-x-1-2-swift-fit>: HTTP status code is not handled or not allowed
2026-01-10 20:40:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/urethane-jaw-coupling-insert-style-l190>: HTTP status code is not handled or not allowed
2026-01-10 20:40:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cast-iron-jaw-coupling-hub-style-l035-5-16-inch-bore-diameter-no-keyway>: HTTP status code is not handled or not allowed
2026-01-10 20:40:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plug-in-y-conn-8mm-stud-x-8mm-tube>: HTTP status code is not handled or not allowed
2026-01-10 20:40:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-pivoting-forklift-jib-boom-crane-6000-lbs-capacity-30in-fork-centers>: HTTP status code is not handled or not allowed
2026-01-10 20:40:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-32-balldriver-screwdriver-long-10709>: HTTP status code is not handled or not allowed
2026-01-10 20:40:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-valve-female-iso-228-w-exhaust-hole-1-8-x-1-8>: HTTP status code is not handled or not allowed
2026-01-10 20:40:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/swivel-y-6mm-tube-x-m5-male-bspp>: HTTP status code is not handled or not allowed
2026-01-10 20:40:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forced-air-circulation-incubator-53-liters-115-volt>: HTTP status code is not handled or not allowed
2026-01-10 20:40:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/natural-convection-incubator-programmable-32-liters-115-volt>: HTTP status code is not handled or not allowed
2026-01-10 20:40:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carbon-steel-inside-spring-caliper-0-10-5-8-range>: HTTP status code is not handled or not allowed
2026-01-10 20:40:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electronic-screw-thread-micrometer-0-1-inch-0-25mm-range>: HTTP status code is not handled or not allowed
2026-01-10 20:40:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chamfer-gage-0-5mm-graduation>: HTTP status code is not handled or not allowed
2026-01-10 20:40:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combination-square-set-2-piece-set>: HTTP status code is not handled or not allowed
2026-01-10 20:40:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/telescoping-magnetic-pick-up-and-flashlight>: HTTP status code is not handled or not allowed
2026-01-10 20:40:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/taper-gage-1-32-5-8-inch-range>: HTTP status code is not handled or not allowed
2026-01-10 20:40:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shield-flat-direct-mount-w-o-interlock-7-inch-w-x-6-inch-h>: HTTP status code is not handled or not allowed
2026-01-10 20:40:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shield-octagonal-direct-mount-w-interlock-28-inch-l-x-10-inch-w>: HTTP status code is not handled or not allowed
2026-01-10 20:40:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-ply-looped-end-mop-w-1-green-band-medium-blue-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 20:40:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-ply-anti-microbial-looped-end-mop-w-green-band-medium-natural-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 20:40:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-ply-looped-end-mop-w-5-red-band-large-blue-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 20:40:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cafeteria-tray-17-78l-x-14w-antimicrobial-black>: HTTP status code is not handled or not allowed
2026-01-10 20:40:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ecp-single-face-foam-dispenser-60-inch-l>: HTTP status code is not handled or not allowed
2026-01-10 20:40:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ecp-poly-bag-tubing-stand-36-inch-roll>: HTTP status code is not handled or not allowed
2026-01-10 20:40:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bird-shock-charger-9kvdc-110v-black>: HTTP status code is not handled or not allowed
2026-01-10 20:40:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mounting-cable-tie-8l-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:40:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stealthnet-bird-netting-50l-x-25w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:40:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/net-ring-tool-for-applying-net-rings-to-bird-netting>: HTTP status code is not handled or not allowed
2026-01-10 20:40:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/synthetic-winch-line-extension-w-integrated-shackle-58-dia-x-25l>: HTTP status code is not handled or not allowed
2026-01-10 20:40:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rbw-vinyl-bumper-truck-all-swivel-20-bushel-capacity-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:40:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/intercept-micro-filter-bag-fits-proteam-backpack-vacuum-closed-collar-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:40:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glennville-lounge-chair-coastal-teak>: HTTP status code is not handled or not allowed
2026-01-10 20:40:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/muskoka-adirondack-deck-dining-chair-46-12h-coastal-teak>: HTTP status code is not handled or not allowed
2026-01-10 20:40:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/muskoka-adirondack-deck-dining-chair-40-12h-whitewash>: HTTP status code is not handled or not allowed
2026-01-10 20:40:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ridgecrest-pergola-138l-x-138w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:40:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/muskoka-adirondack-3-piece-bistro-dining-set-30h-table-nantucket-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:40:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/national-rectangular-picnic-table-29-1316h-weathered-acorn>: HTTP status code is not handled or not allowed
2026-01-10 20:40:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gainesville-night-lines-slab-door-wood-36w-x-80h-ice-maple>: HTTP status code is not handled or not allowed
2026-01-10 20:40:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ocala-night-lines-slab-door-wood-36w-x-80h-white>: HTTP status code is not handled or not allowed
2026-01-10 20:40:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tampa-glazed-light-slab-door-wood--glass-36w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:41:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/palmdale-slab-door-wood-24w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:41:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/labella-slab-door-wood-36w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:41:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/naples-night-lines-slab-door-wood-24w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:41:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-west-night-lines-slab-door-wood-28w-x-80h-ice-maple>: HTTP status code is not handled or not allowed
2026-01-10 20:41:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-largo-gold-lines-slab-door-wood-24w-x-80h-ice-maple>: HTTP status code is not handled or not allowed
2026-01-10 20:41:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-largo-night-lines-slab-door-wood-24w-x-80h-white>: HTTP status code is not handled or not allowed
2026-01-10 20:41:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pensacola-glazed-light-slab-door-wood--glass-32w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:41:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ocala-night-lines-slab-door-wood-28w-x-80h-white>: HTTP status code is not handled or not allowed
2026-01-10 20:41:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/european-magnetic-lockset-keyed-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/naples-gold-lines-slab-door-wood-24w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:41:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gainesville-gold-lines-slab-door-wood-24w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:41:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/key-largo-gold-lines-slab-door-wood-28w-x-80h-whiskey-oak>: HTTP status code is not handled or not allowed
2026-01-10 20:41:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/handle-w-basic-american-passage-lockset-nickel>: HTTP status code is not handled or not allowed
2026-01-10 20:41:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/outdoor-dining-set-27-1-2-in-square-teakwood-table-4-sling-armchairs>: HTTP status code is not handled or not allowed
2026-01-10 20:41:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-shower-commode-chair-removable-soft-seat-435-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:41:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hog-heavenanti-fatigue-mat-58-thick-30l-x-5w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21020 pages (at 100 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:41:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hog-heavenanti-fatigue-mat-58-thick-40l-x-3w-black-striped-border>: HTTP status code is not handled or not allowed
2026-01-10 20:41:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hog-heavenanti-fatigue-mat-78-thick-25l-x-4w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cushion-max-anti-fatigue-mat-58-thick-5l-x-2w-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 20:41:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hog-heavenanti-fatigue-mat-58-thick-50l-x-5w-black-striped-border>: HTTP status code is not handled or not allowed
2026-01-10 20:41:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polywoven-dunnage-air-bags-8-ply-102l-x-57-12w-pack-of-90>: HTTP status code is not handled or not allowed
2026-01-10 20:41:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infinity-2-tier-2-door-locker-18-in-w-x-21-in-d-x-36-in-h-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:41:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-174-chrome-2-tier-wire-shelf-basket-solid-top-shelf-48-w-x-24-d-x-34-h>: HTTP status code is not handled or not allowed
2026-01-10 20:41:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-hivis-3-in-1-rainwear-jacket-xl-black-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:41:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-hivis-softshell-insulated-pants-medium-black-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:41:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polarforce-hiker-boots-size-5-5-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polarforce-mens-hivis-sweatshirt-2xl-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:41:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polarforce-mens-hivis-sweatshirt-medium-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:41:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polarforce-hiker-boots-size-9-5-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polarforce-mens-sweatshirt-large-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polarforce-mens-sweatshirt-medium-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liquid-coffee-creamer-cafe-mocha-0-38-oz-mini-cups-pack-of-200>: HTTP status code is not handled or not allowed
2026-01-10 20:41:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zero-calorie-sweetener-1-g-pack-of-1600>: HTTP status code is not handled or not allowed
2026-01-10 20:41:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fork-polypropylene-white-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deerfield-printed-paper-plates-6-dia-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pathways-paper-plates-wise-size-8-1-2-dia-green-burgundy-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:41:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classicware-plastic-plates-9-dia-clear-pack-of-180>: HTTP status code is not handled or not allowed
2026-01-10 20:41:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mediumweight-wrapped-soup-spoon-polypropylene-white-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavyweight-wrapped-knife-polystyrene-black-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mediumweight-wrapped-fork-polypropylene-white-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavyweight-wrapped-soup-spoon-polypropylene-white-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foam-container-7-1-4-l-x-3-w-x-2-h-white-pack-of-504>: HTTP status code is not handled or not allowed
2026-01-10 20:41:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-cold-drink-cups-32-oz-clear-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:41:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/greenstripe-renewable-compostable-cold-drink-cups-16-oz-clear-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gen-freezer-paper-1-000-l-x-18-w-white>: HTTP status code is not handled or not allowed
2026-01-10 20:41:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interfolded-soy-wax-deli-sheets-10-3-4-l-x-12-w-pack-of-6000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comet-plastic-squat-tumblers-5-oz-clear-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durable-packaging-aluminum-closable-container-silver-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-cold-drink-cups-polypropylene-3-oz-translucent-pack-of-120>: HTTP status code is not handled or not allowed
2026-01-10 20:41:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/container-w-3-compartment-9-1-8-l-x-9-w-x-3-1-4-h-white-pk-of-150>: HTTP status code is not handled or not allowed
2026-01-10 20:41:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tray-w-56-fork-56-knives-56-spoons-combo-pack-white-pack-of-1008>: HTTP status code is not handled or not allowed
2026-01-10 20:41:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/school-napkin-spork-straw-cutlery-kit-white-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smartlock-container-9-1-8-l-x-9-w-x-3-1-4-h-white-pack-of-150>: HTTP status code is not handled or not allowed
2026-01-10 20:41:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/container-9-l-x-5-3-8-w-x-3-1-2-h-clear-pack-of-250>: HTTP status code is not handled or not allowed
2026-01-10 20:41:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flexible-wrapped-straws-7-3-4-l-white-pack-of-10000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-hot-drink-cups-12-oz-white-pack-of-1k>: HTTP status code is not handled or not allowed
2026-01-10 20:41:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bowl-coated-soak-proof-12-oz-pack-of-1-000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cup-sleeves-for-10-oz-to-20-oz-hot-drink-cups-kraft-pack-of-1200>: HTTP status code is not handled or not allowed
2026-01-10 20:41:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/non-vented-cup-lids-for-9-oz-to-22-oz-cups-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:41:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/non-lifting-synthetic-shackle-3-8-dia-x-5-l-5-5-8-ton-wll>: HTTP status code is not handled or not allowed
2026-01-10 20:41:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-led-t8-4-led-tube-40k-18w-2200-lumens-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 20:41:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mid-turbinate-swab-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:41:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dust-extraction-attachment-for-rotary-hammer>: HTTP status code is not handled or not allowed
2026-01-10 20:41:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t30-1-impact-driver-bit-pack-of-20>: HTTP status code is not handled or not allowed
2026-01-10 20:41:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-impact-magnetic-extension-holder>: HTTP status code is not handled or not allowed
2026-01-10 20:41:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colormaxx-paint-primer-12-oz-white-primer-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:41:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/colormaxx-paint-primer-12-oz-satin-black-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:41:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delphi-x-observer-trinocular-microscope-w-plan-semi-apochromatic>: HTTP status code is not handled or not allowed
2026-01-10 20:41:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delphi-x-observer-trinocular-microscope-w-plan-phase-plphi-1020s40s100x>: HTTP status code is not handled or not allowed
2026-01-10 20:41:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-capacity-boltless-steel-shelf-72-in-w-x-36-in-d>: HTTP status code is not handled or not allowed
2026-01-10 20:41:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/templog-premier-chromatography-refrigerator-49-cuft-capacity-glass-door>: HTTP status code is not handled or not allowed
2026-01-10 20:41:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ductless-mini-split-air-conditioner-w-heat-pump-wifi-enabled-36000-btu-3-ton-25ft-lineset>: HTTP status code is not handled or not allowed
2026-01-10 20:41:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hardwood_floor_stripping_polishing_cleaning_pad_chemical_package_20>: HTTP status code is not handled or not allowed
2026-01-10 20:41:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8995-hard-hat-face-shield-for-full-brim-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:41:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arm-elevator-sling-dark-blue-small>: HTTP status code is not handled or not allowed
2026-01-10 20:41:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/serpentine-style-cervical-collar-firm-23-12l-x-5h-large>: HTTP status code is not handled or not allowed
2026-01-10 20:41:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/instant-hot-packs-9l-x-4w-pack-of-24>: HTTP status code is not handled or not allowed
2026-01-10 20:41:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kidz-pediatric-wheelchair-12w-seat>: HTTP status code is not handled or not allowed
2026-01-10 20:41:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microban-elements-transfer-bench-350-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:41:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/offset-handle-cane-500-lb-capacity-steel-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:41:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/terry-adult-bib-w-hook-loop-strap-10-oz-33l-x-21w-white-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:41:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bariatric-quad-cane-large-base-500-lb-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/curad-instant-cold-pack-24-per-box-4-boxes-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:41:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guardian-k3-wheelchair-w-desk-length-arms-swing-away-footrests-20w-seat>: HTTP status code is not handled or not allowed
2026-01-10 20:41:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/graduated-triangular-intakeoutput-container-1000-ml-200-per-pack20-packs-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:41:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comprecares-reusable-compression-garment-kit-medium-tall-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ifob-test-kits-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 20:41:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-head-plastic-goniometer-12l-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:41:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/non-sterile-cotton-balls-large-1-14dia-white-1000-per-bag2-bags-per-case>: HTTP status code is not handled or not allowed
2026-01-10 20:41:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pathway-straight-wheelchair-ramp-kit-aluminum-4-top-platform-22l-x-36w>: HTTP status code is not handled or not allowed
2026-01-10 20:41:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/torch-pulse-welding-gloves-medium-black>: HTTP status code is not handled or not allowed
2026-01-10 20:41:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panel-moving-truck-steel-1400-lb-capacity-31-3-16l-x-28-1-4w-x-33-15-16h>: HTTP status code is not handled or not allowed
2026-01-10 20:41:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rolling-service-cart-steel-1200-lb-capacity-66-1-4l-x-30-1-4w-x-55-5-8h>: HTTP status code is not handled or not allowed
2026-01-10 20:41:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deck-mount-add-on-faucet-w-10-spout>: HTTP status code is not handled or not allowed
2026-01-10 20:41:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/delta-pressure-balance-cartridge-for-multi-choice-valves-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:41:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vu500-15-upright-vacuum-14-12-cleaning-width>: HTTP status code is not handled or not allowed
2026-01-10 20:41:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sw900-battery-sweeper-33-cleaning-width>: HTTP status code is not handled or not allowed
2026-01-10 20:41:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bu800-20bt-battery-burnisher-234ah-25-hp>: HTTP status code is not handled or not allowed
2026-01-10 20:41:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neoprenevinyl-dumbbell-storage-rack-4-tier-24l-x-33w-x-36h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/horizontal-wall-bar-holder-8-18l-x-1-1116w-x-20-516h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kettlebell-prime-15-lb>: HTTP status code is not handled or not allowed
2026-01-10 20:42:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stepper-ankle-band-intermediate-resistance-10l-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:42:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/covered-tube-heavy-resistance-48l-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:42:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/business-furniture-coventry-l-shaped-sectional-couch-111w-x-111d-x-35-3-4h-cream>: HTTP status code is not handled or not allowed
2026-01-10 20:42:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/business-furniture-hybrid-file-cabinet-w-2-drawers-36w-x-23-3-8d-x-29-13-16h-white>: HTTP status code is not handled or not allowed
2026-01-10 20:42:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-stream-recycling-trash-can-86-gallon-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/beverage-center-1-glass-door-45-cuft-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:42:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-slice-countertop-toaster-oven-04-cuft-capacity-1100-watts>: HTTP status code is not handled or not allowed
2026-01-10 20:42:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/countertop-microwave-900-watts-09-cuft-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apartment-size-refrigerator-17-cuft-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 20:42:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proform-switchpoint-climbingconstruction-harness-tongue-buckle-legs-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:42:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-brushless-cordless-driver-drill-kit-2-speed>: HTTP status code is not handled or not allowed
2026-01-10 20:42:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-174-chrome-5-tier-wire-shelving-starter-unit-36-w-x-12-d-x-74-h>: HTTP status code is not handled or not allowed
2026-01-10 20:42:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-power-scissor-lift-table-48-in-x-48-in-3000-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:42:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cabinet-w-fixed-shelves-assembled-48w-x-24d-x-72h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sliding-door-cabinet-assembled-36w-x-21d-x-72h-dove-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:42:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21121 pages (at 101 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:42:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/organizer-mobile-cabinet-assembled-48w-x-24d-x-78h-navy-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:42:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bookcase-assembled-36w-x-18d-x-45h-navy-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:42:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bookcase-assembled-36w-x-18d-x-45h-walnut>: HTTP status code is not handled or not allowed
2026-01-10 20:42:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bookcase-assembled-36w-x-13d-x-60h-pastel-green>: HTTP status code is not handled or not allowed
2026-01-10 20:42:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bookcase-assembled-36w-x-18d-x-75h-red>: HTTP status code is not handled or not allowed
2026-01-10 20:42:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-wardrobe-cabinet-assembled-36w-x-24d-x-72h-wine-red>: HTTP status code is not handled or not allowed
2026-01-10 20:42:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teardrop-pallet-rack-starter-48-in-w-x-24-in-d-x-120-in-h>: HTTP status code is not handled or not allowed
2026-01-10 20:42:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onyx-standard-safety-vest-w-black-contrasting-trim-class-2-xl-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:42:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-hype-lite-heavy-duty-vest-lgxl-red>: HTTP status code is not handled or not allowed
2026-01-10 20:42:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onyx-standard-safety-vest-w-lime-contrasting-trim-3xl-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-hype-lite-heavy-duty-vest-4xl5xl-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-hype-lite-heavy-duty-vest-smmd-purple>: HTTP status code is not handled or not allowed
2026-01-10 20:42:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/onyx-job-shirt-w-14-zipper-class-3-polyester-fleece-lime-large>: HTTP status code is not handled or not allowed
2026-01-10 20:42:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-premium-heavy-duty-vest-w-multi-pockets-4xl5xl-forest-green>: HTTP status code is not handled or not allowed
2026-01-10 20:42:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enhanced-visibility-premium-heavy-duty-vest-w-multi-pockets-sm-forest-green>: HTTP status code is not handled or not allowed
2026-01-10 20:42:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/friedrich--commercial-windowwall-air-conditioner-w-heat-pump-917-watts-115-v-10k-btu>: HTTP status code is not handled or not allowed
2026-01-10 20:42:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-platform-truck-w-end--side-handle-3600-lb-cap-72l-x-30w-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:42:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-sided-shelf-truck-w-mesh-sides-3600-lb-cap-65-12l-x-30w-x-57h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:42:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-class-2-hi-vis-safety-vest-2-reflective-strips-poly-solid-lime-4xl-5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:42:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-hi-2-reflective-strips-4-pockets-lime-size-l>: HTTP status code is not handled or not allowed
2026-01-10 20:42:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-817wp-thermal-waterproof-winter-work-gloves-w-reinforced-palms-2xl-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8381-hi-vis-4-in-1-winter-bomber-jacket-5xl-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:42:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8287-hi-vis-winter-jacket--vest-w-detachable-sleeves-medium-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:42:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8386-hi-vis-shell-jacket-medium-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:42:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8384-hi-vis-quilted-parka-winter-jacket-xl-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:42:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8287-hi-vis-winter-jacket--vest-w-detachable-sleeves-large-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:42:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8280bk-hi-vis-performance-t-shirt-black-bottom-class-2-xl-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:42:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chill-its-6689-cooling-long-sleeve-sun-shirt-w-uv-protection-xl-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:42:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-7031-cut-resistant-gloves-nitrile-coated-ansi-a3-s-gray-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:42:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8372-hi-vis-hooded-sweatshirt-black-bottom-full-zip-class-3-4xl-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:42:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-7022-cut-resistant-gloves-dsx-coated-ansi-a2-s-lime-144-pairs>: HTTP status code is not handled or not allowed
2026-01-10 20:42:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-7024-cut-resistant-gloves-polyurethane-coated-ansi-a2-2xl-gray-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:42:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-6472-insulated-bib-overalls-300d-oxford-shell-polyester-s-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8379-hi-vis-3-in-1-winter-bomber-jacket-2xl-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:42:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz-8944-soft-universal-bump-cap-insert-foam-pack-of-2-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n-ferno-6468-duck-canvas-work-jacket-xl-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/chill-its-6695-sun-protection-arm-sleeves-ml-camo-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:42:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n-ferno-6468-duck-canvas-work-jacket-large-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digger-78-x-3-14-hex-shank-2350-bpm-25-stroke-length-169-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:42:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extended-air-die-grinder-14-and-6mm-collets-burr-18000-rpm-1-hp-rear-exhaust>: HTTP status code is not handled or not allowed
2026-01-10 20:42:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pavement-breaker-1-18-x-6-hex-shank-625-stroke-length-1-34-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:42:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/right-angle-air-grinder-45-type-27-wheel-58-in-11-thread-12000-rpm-1-hp-rear-exhaust>: HTTP status code is not handled or not allowed
2026-01-10 20:42:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-duty-air-chisel-scaler-3000-bpm-14-stroke-length-093-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:42:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-high-torque-12-cordless-impact-wrench-kit-1500-ft-lbs-nut-busting-torque-2-batteries-and-charger-2-extended-anvil>: HTTP status code is not handled or not allowed
2026-01-10 20:42:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20v-high-torque-1-cordless-impact-wrench-2600-ft-lbs-nut-busting-torque>: HTTP status code is not handled or not allowed
2026-01-10 20:42:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-tier-4-door-digital-locker-12in-w-x-15in-d-x-78in-h-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:42:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-tier-6-door-digital-locker-12in-w-x-12in-d-x-78in-h-blue-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:42:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-refrigerator-freezer-ada-height-32-cu-ft-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 20:42:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/procedure-stat-cart-w-4-drawers-23l-x-26-14w-x-40h>: HTTP status code is not handled or not allowed
2026-01-10 20:42:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-rubber-pad-for-w-755aa>: HTTP status code is not handled or not allowed
2026-01-10 20:42:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microswitch-for-fs-long-hand-sealer--fkr-a-double-impulse-portable-sealer>: HTTP status code is not handled or not allowed
2026-01-10 20:42:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-kit-for-yc-450fc>: HTTP status code is not handled or not allowed
2026-01-10 20:42:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-rubber-sponge-for-wn-650h-wn-650hc>: HTTP status code is not handled or not allowed
2026-01-10 20:42:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/silicone-rubber-pad-for-fs-1000h>: HTTP status code is not handled or not allowed
2026-01-10 20:42:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-convex-mirror-w-galvanised-metal-backer-plastic-outdoor-12-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:42:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-convex-mirror-w-stainless-steel-backer-plastic-outdoor-18-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:42:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/daredevil-multipurpose-drill-bit-set-5-piece-set>: HTTP status code is not handled or not allowed
2026-01-10 20:42:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tough-coat-adv-spray-paint-w-rust-barrier-technology-20-oz-cap-gloss-safety-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:42:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-shaped-bur-single-cut-2l-x-18-shank-dia-18-cut-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:42:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/radius-cylindrical-bur-singlecut-3l-x-18-shank-dia-18-cut-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:42:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/radius-tree-shaped-bur-double-cut-1-12l-x-18-shank-dia-14-len-of-cut>: HTTP status code is not handled or not allowed
2026-01-10 20:42:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylindrical-w-endcut-bur-double-cut-18-shank-dia-716-len-of-cut>: HTTP status code is not handled or not allowed
2026-01-10 20:42:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flame-shaped-bur-single-cut-3l-x-14-shank-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:42:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylindrical-no-endcut-bur-double-cut-2-34l-x-14-shank-dia-1-cut-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:42:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bur-box-sa43-sa42-sc42-sc41-sd42-se41-sf41-sg41-sh41-sj42-sl42-sn42>: HTTP status code is not handled or not allowed
2026-01-10 20:42:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ez-all-purpose-accessory-storage-kit-70-pieces>: HTTP status code is not handled or not allowed
2026-01-10 20:42:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-round-mini-panel-motion-sensor-fixture-18w-1400-lumens-90-cri-12-size-white>: HTTP status code is not handled or not allowed
2026-01-10 20:42:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dusk-till-dawn-stop-sign-solar-30w-x-2d-x-30h-whitered>: HTTP status code is not handled or not allowed
2026-01-10 20:42:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-wraparound-fixture-40w-120-277v-5360-lumens-4000k-cool-white>: HTTP status code is not handled or not allowed
2026-01-10 20:42:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-g165-bulb-120v-5w-350-lumens-candelabra-screw-base-white-1-lb-wt-pk-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:42:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-g165-bulb-120v-5w-500-lumens-candelabra-screw-base-warm-white-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:42:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/led-cube-up-or-down-outdoor-light-fixture-9w-650-lumens-80-cri-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prefilled-2ml-tubes-for-6-mm-ceria-based-zirconium-oxide-satellite-pack-of-50>: HTTP status code is not handled or not allowed
2026-01-10 20:42:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mytemp-mini-co2-digital-incubator-07-cuft-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:42:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/biztalk-business-radio-4-channels-450-470-mhz-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/incu-mixer-mp4-heated-micro-plate-vortexer-1500-rpm-115v>: HTTP status code is not handled or not allowed
2026-01-10 20:42:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mini-blotboy-3d-rocker-w-flat-mat-230v-5060-hz-20-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:42:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tube-holder-for-11-x-1520ml-2-per-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:42:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4mm-stainless-steel-grinding-ball-pack-of-5000>: HTTP status code is not handled or not allowed
2026-01-10 20:42:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-balance-3200g-capacity-001g-readability-115v>: HTTP status code is not handled or not allowed
2026-01-10 20:42:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-air-compressor-w-wheels-2-hp-5-gallon-capacity-side-stack-5-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:42:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-octagon-sign-base-w-wheels-60-lb-black>: HTTP status code is not handled or not allowed
2026-01-10 20:42:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tread-plate-deck-platform-truck-aluminum-6-polyurethane-caster-63l-x-36w-2600-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:43:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-platform-truck-w-6-polyurethane-casters-62l-x-18w-1200-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:43:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-end-mill-2-flute-2-12l-x-38-dia-78-cut-length>: HTTP status code is not handled or not allowed
2026-01-10 20:43:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-end-mill-power-a-2-flute-2-12l-x-14-dia-34-cut-length>: HTTP status code is not handled or not allowed
2026-01-10 20:43:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/excelon-plus-oil-vapour-removal-filter-w-closed-metal-bowl-12-iso-g-0003-m>: HTTP status code is not handled or not allowed
2026-01-10 20:43:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optional-bottom-shelf-for-30w-tmt-cart-28w-x-28-1116d-x-1-516h-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:43:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-add-on-48l-x-32w-x-84h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-add-on-48l-x-32w-x-72h-antique-white>: HTTP status code is not handled or not allowed
2026-01-10 20:43:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-sided-starter-36l-x-20w-x-84h-antique-white>: HTTP status code is not handled or not allowed
2026-01-10 20:43:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-starter-36l-x-24w-x-84h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-starter-48l-x-40w-x-60h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-unit-w-t-joiner-support-clip-48l-x-18w-x-54h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optimus-power-scissor-lift-table-hand-operated-5000-cap-3ph-480v-72l-x-48w>: HTTP status code is not handled or not allowed
2026-01-10 20:43:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-starter-48l-x-36w-x-54h-antique-white>: HTTP status code is not handled or not allowed
2026-01-10 20:43:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-sided-starter-36l-x-36w-x-96h-antique-white>: HTTP status code is not handled or not allowed
2026-01-10 20:43:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-unit-w-t-joiner-support-clip-48l-x-16w-x-48h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optimus-power-scissor-lift-table-foot-operated-3000-cap-3ph-230v-48l-x-36w>: HTTP status code is not handled or not allowed
2026-01-10 20:43:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21219 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:43:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uv-air-purifier-w-hepa-filter-58w-110v-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/marque-quad-unit-reception-curved-desk-workstation-142w-x-103d-x-45-12h-cherry>: HTTP status code is not handled or not allowed
2026-01-10 20:43:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylinder-graduated-globe-glass-class-b-to-deliver-td-dual-grads-astm-e1272-250ml-2-box>: HTTP status code is not handled or not allowed
2026-01-10 20:43:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reelsafe-spring-retractable-hose-reel-3000-psi-12-id-x-50l>: HTTP status code is not handled or not allowed
2026-01-10 20:43:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylinder-graduated-globe-glass-class-b-to-deliver-td-dual-grads-astm-e1272-50ml-4-box>: HTTP status code is not handled or not allowed
2026-01-10 20:43:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylinder-graduated-globe-glass-class-b-to-deliver-td-dual-grads-astm-e1272-2000ml>: HTTP status code is not handled or not allowed
2026-01-10 20:43:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mmb-ytz12s-12v-11ah-210cca-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:43:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mmb-ytx12-bsgel-12v-10ah-180cca-gel-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:43:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mmb-ytx14ahl-12v-12ah-210cca-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:43:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/identification-tag-4-inch-x-2-inch-tan-37082>: HTTP status code is not handled or not allowed
2026-01-10 20:43:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/array153-signal-iaq-sensor-monitor-120v-ac-white>: HTTP status code is not handled or not allowed
2026-01-10 20:43:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/490-blood-pressure-cuff-for-535-spot-check-vital-signs-monitor-small>: HTTP status code is not handled or not allowed
2026-01-10 20:43:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-3-bar-steel-ladder-roof-rack-for-nissan-nv-cargo-van-2011-on-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/healthy-soap-05-pcmx-foam-refill-for-cs8-dispensers-1200-ml-capacity-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:43:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h1-3-bar-aluminum-ladder-rack-for-ram-promaster-cargo-van-2013-on-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conduit-carrier-caps-fits-2-x-1-cross-bars-6-tube-not-included-aluminum-6-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:43:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precision-series-trash-container-w-cigarette-receptacle-40-gal-cap-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:43:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hip-pack-w-guard-logo-first-aid-supply-royal-blue-49-pieces>: HTTP status code is not handled or not allowed
2026-01-10 20:43:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cprb-led-round-high-bay-120001500018000-lumens-40005000k-80-cri-white>: HTTP status code is not handled or not allowed
2026-01-10 20:43:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polytec153-recycling-container-w-riverstone-panels-42-gal-cap-green>: HTTP status code is not handled or not allowed
2026-01-10 20:43:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sf-multi-function-beacon-terminal-blocks-buzzer-24v-red>: HTTP status code is not handled or not allowed
2026-01-10 20:43:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60sk32-qd-bushed-34-pitch-32-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-ceramic-utility-heater-w-pivot-power-1500w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extreme-cold-weather-kit-for-4-5l-48kw>: HTTP status code is not handled or not allowed
2026-01-10 20:43:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-16bs23x45-metric-1-pitch-45mm-finished-bore-23-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36-w-locker-bench-laminate-top-steel-tube-pedestals>: HTTP status code is not handled or not allowed
2026-01-10 20:43:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ambu-adult-bag-valve-mask-w-hepa-filter>: HTTP status code is not handled or not allowed
2026-01-10 20:43:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-rock-3-way-panhead-aluminum-lightweight-tripod-with-carrying-case-65-1-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-20bs12hx32-metric-1-14-pitch-32mm-finished-bore-12-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lume-cob-led-magnifier-3-5-with-2-5x-7x-magnification-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-120e22h-qd-bushed-1-12-pitch-22-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/illuminated-hand-held-aspheric-magnifier-1-5-7x-led-lighted-white>: HTTP status code is not handled or not allowed
2026-01-10 20:43:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ada-height-upright-controlled-room-temperature-cabinet-6-cuft-capacity-glass-door>: HTTP status code is not handled or not allowed
2026-01-10 20:43:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/upright-controlled-room-temperature-cabinet-8-cuft-capacity-solid-door>: HTTP status code is not handled or not allowed
2026-01-10 20:43:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80btl25h-bushed-tapered-locks-1-pitch-25-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/image-design-foam-skincare-automatic-dispenser-intuition-sensor-1l>: HTTP status code is not handled or not allowed
2026-01-10 20:43:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-safety-crafted-waterproof-wellington-work-boots-steel-toe-size-12m-10-inch-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:43:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-20bs13hx42-metric-1-14-pitch-42mm-finished-bore-13-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-safety-crafted-waterproof-work-boots-steel-toe-size-9w-6-inch-h-dark-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:43:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-safety-crafted-waterproof-work-boots-steel-toe-size-9-5w-6-inch-h-dark-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:43:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/healthcare-advanced-foam-hand-sanitizer-1200-ml-cranberry-for-es8-dispensers-2-ctn>: HTTP status code is not handled or not allowed
2026-01-10 20:43:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-strong-scented-tall-white-kitchen-bags-13-gal-0-9-mil-white-80-box>: HTTP status code is not handled or not allowed
2026-01-10 20:43:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs35hx34-38-pitch-34-finished-bore-35-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs25x178-1-pitch-1-78-finished-bore-25-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100bs19hx11516-1-14-pitch-1-1516-finished-bore-19-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs35hx1316-38-pitch-1-316-finished-bore-35-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-41bs20hx34-12-pitch-34-finished-bore-20-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100a09hx1-a-plate-1-14-pitch-1-bore-9-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-16a30-metric-1-pitch-30mm-bore-30-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100a27x138-a-plate-1-14-pitch-1-38-bore-27-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-safety-crafted-waterproof-wellington-work-boots-steel-toe-size-11-5m-10-inch-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:43:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs14hx1716-34-pitch-1-716-finished-bore-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/professional-fresh-scent-foam-soap-for-cx-cxi-cxt-dispensers-1500-ml-4-carton>: HTTP status code is not handled or not allowed
2026-01-10 20:43:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-06bs23hx19-metric-38-pitch-19mm-finished-bore-23-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs16hx48-metric-1-12-pitch-48mm-finished-bore-16-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/indoor-flashing-led-sign-24-w-x-24-h-white-red>: HTTP status code is not handled or not allowed
2026-01-10 20:43:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60sds17h-qd-bushed-34-pitch-17-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/defib-pads-2346n-6-inch-x-4-5-inch-10-pack-carton-10-carton-case>: HTTP status code is not handled or not allowed
2026-01-10 20:43:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/groundbreaker-work-boots-w-internal-met-guard-steel-toe-size-8-5w-6-inch-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:43:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-men-s-low-cut-sneaker-composite-toe-size-7m-gray-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-high-top-sneaker-composite-toe-size-16m-black-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:43:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs13hx42-metric-1-12-pitch-42mm-finished-bore-13-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50a21hx34-a-plate-58-pitch-34-bore-21-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duraprep-surgical-solution-applicator-8635-6-ml-50-cs>: HTTP status code is not handled or not allowed
2026-01-10 20:43:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/groundbreaker-pull-on-boots-composite-toe-size-13m-11-inch-h-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:43:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bair-hugger-flex-warming-gown-81103-small-44-inch-l-20-case>: HTTP status code is not handled or not allowed
2026-01-10 20:43:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs32hx58-38-pitch-58-finished-bore-32-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100bs24hx2716-1-14-pitch-2-716-finished-bore-24-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steri-drape-incise-drape-1051-incise-area-23-inch-x-33-inch-10-carton-4-cartons-case>: HTTP status code is not handled or not allowed
2026-01-10 20:43:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-24bs13hx25-metric-1-12-pitch-25mm-finished-bore-13-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truflex-fly-skylar-work-zip-bootie-composite-toe-size-6m-4-inch-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-20bs20hx45-metric-1-14-pitch-45mm-finished-bore-20-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-microcentrifuge-tubes-with-cap-sterile-1-5-ml-purple-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:43:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vitals-skate-inspired-work-shoes-composite-toe-size-11-5m-rinsed-black-tower-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:43:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs32hx34-38-pitch-34-finished-bore-32-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs32hx118-38-pitch-1-18-finished-bore-32-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs32hx1316-38-pitch-1-316-finished-bore-32-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-halo-pipettor-starter-kit-with-6-place-carousel-stand>: HTTP status code is not handled or not allowed
2026-01-10 20:43:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-men-s-low-cut-sneaker-composite-toe-size-15m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:43:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50sds21h-qd-bushed-58-pitch-21-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:43:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-propette-manual-pipette-controller-with-filter>: HTTP status code is not handled or not allowed
2026-01-10 20:44:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zig-elusion-heritage-work-men-s-low-cut-sneaker-composite-toe-size-11-5m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-microcentrifuge-tubes-with-cap-sterile-0-5-ml-assorted-500-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:44:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truflex-fly-skylar-sneaker-composite-toe-size-11w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-propette-le-single-channel-pipette-10-100ul>: HTTP status code is not handled or not allowed
2026-01-10 20:44:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-10a16h-metric-a-plate-58-pitch-12mm-bore-16-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truflex-fly-skylar-sneaker-composite-toe-size-7-5m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-clearseal-microcentrifuge-tubes-with-self-standing-sterile-0-5-ml-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:44:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-microcentrifuge-tubes-sterile-1-5-ml-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:44:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35b25hx12mpb-38-pitch-12-plain-bore-25-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35bs25hx1-38-pitch-1-finished-bore-25-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/true-skate-inspired-work-shoes-composite-toe-size-8-5m-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:44:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-blood-bank-transfer-pipette-5-ml-non-sterile-250-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:44:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100a08hx1-a-plate-1-14-pitch-1-bore-8-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bio-reservoir-for-multi-channel-pipettes-divided-50-ml-sterile-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:44:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21314 pages (at 95 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:44:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-100btl35-taper-bushed-1-14-pitch-35-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-12a16h-metric-a-plate-34-pitch-14mm-bore-16-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truflex-fly-mudguard-slip-on-sneaker-composite-toe-size-7-5m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-120a48x114-a-plate-1-12-pitch-1-14-bore-48-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polaris-600-snowmobile-replacement-battery-1985-1987-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 20:44:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/true-skate-inspired-work-shoes-composite-toe-size-10-5w-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:44:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs11hx1-34-pitch-1-finished-bore-11-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35b28hx12mpb-38-pitch-12-plain-bore-28-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-60bs13hx1-34-pitch-1-finished-bore-13-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/true-skate-inspired-work-shoes-composite-toe-size-11-5m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-skate-inspired-work-shoes-composite-toe-size-7-5m-black-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:44:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apc-rbc123-ups-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:44:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs13hx34-58-pitch-34-finished-bore-13-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs14hx58-58-pitch-58-finished-bore-14-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-crafted-western-work-boots-steel-toe-size-7-5m-brown-burnt-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:44:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-skate-inspired-work-shoes-composite-toe-size-7w-gray-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pacetronics-esopace-medical-replacement-battery-10ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-skate-inspired-work-shoes-composite-toe-size-8-5m-blue-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:44:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-10bs20hx32-metric-58-pitch-32mm-finished-bore-20-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-crafted-western-work-boots-w-steel-toe-and-internal-met-guard-size-9-5w-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:44:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-35sh48-38-pitch-qd-bushed-48-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs10hx114-1-pitch-1-14-finished-bore-10-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-10a30h-metric-a-plate-58-pitch-18mm-bore-30-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premier-work-casual-slip-on-sneaker-steel-toe-size-12eee-cognac>: HTTP status code is not handled or not allowed
2026-01-10 20:44:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-12bs15hx25-metric-34-pitch-25mm-finished-bore-15-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-op-art-skate-inspired-work-shoes-composite-toe-size-11m-dark-brown-khaki>: HTTP status code is not handled or not allowed
2026-01-10 20:44:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-seal-bubble-bags-15-x-17-1-2-150-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:44:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/csb-gp412-sealed-lead-acid-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adi-vista-10se-alarm-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-41bs28hx1-12-pitch-1-finished-bore-28-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanoflex-tr-athletic-work-shoes-composite-toe-size-13w-navy-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:44:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premier-work-casual-oxford-shoes-steel-toe-8-5eee-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caterpillar-528-industrial-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adt-420615-alarm-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:44:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-12bs15hx32-metric-34-pitch-32mm-finished-bore-15-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-twist-ties-12-x-5-32-yellow-2000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:44:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acme-622-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanoflex-tr-athletic-work-shoes-composite-toe-size-10-5w-black-camo-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:44:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caterpillar-589-industrial-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanoflex-tr-athletic-work-shoes-composite-toe-size-9-5w-navy-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:44:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/r-d-5394-sealed-lead-acid-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:44:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stone-op-art-skate-inspired-work-shoes-composite-toe-size-12w-dark-brown-khaki>: HTTP status code is not handled or not allowed
2026-01-10 20:44:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-40bs26hx114-12-pitch-1-14-finished-bore-26-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-7-5w-slate-blue-salmon>: HTTP status code is not handled or not allowed
2026-01-10 20:44:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ledm001nkl-1912-led-ceiling-fixtures-35w-4000-cct-2900-lumens-82-cri-white>: HTTP status code is not handled or not allowed
2026-01-10 20:44:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leduc42brz-42-led-undercabinet-16w-3000-cct-1080-lumens-82-cri-bronze>: HTTP status code is not handled or not allowed
2026-01-10 20:44:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/napco-gerbat1-2-alarm-replacement-battery-1-3ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanoflex-tr-athletic-work-shoes-composite-toe-size-8-5m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nanoflex-tr-athletic-work-shoes-composite-toe-size-7-5w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ledpl1wht-led-puck-light-4w-3000-cct-360-lumens-82-cri-white>: HTTP status code is not handled or not allowed
2026-01-10 20:44:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leduc12brz-12-led-undercabinet-5w-3000-cct-300-lumens-82-cri-bronze>: HTTP status code is not handled or not allowed
2026-01-10 20:44:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs20hx112-58-pitch-1-12-finished-bore-20-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ledpl3blk-led-puck-light-12w-3000-cct-1080-lumens-82-cri-bronze>: HTTP status code is not handled or not allowed
2026-01-10 20:44:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clic-retractable-eraser-refillable-red-barrel>: HTTP status code is not handled or not allowed
2026-01-10 20:44:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-6m-slate-blue-salmon>: HTTP status code is not handled or not allowed
2026-01-10 20:44:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-11m-slate-blue-salmon>: HTTP status code is not handled or not allowed
2026-01-10 20:44:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-08bs24hx22-metric-12-pitch-22mm-finished-bore-24-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-9-5m-silver-army-green-pink>: HTTP status code is not handled or not allowed
2026-01-10 20:44:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-al176ulx-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-w-x-30-d-pedestal-workbench-w-7-drawers-plastic-laminate-square-edge-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:44:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paramount-174-storage-cabinet-easy-assembly-36x24x78-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ademco-vista-20p-alarm-replacement-battery-4-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-11-5m-silver-army-green-pink>: HTTP status code is not handled or not allowed
2026-01-10 20:44:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-mid-cut-shoes-composite-toe-size-5w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-mid-cut-shoes-composite-toe-size-5m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bruno-regal-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:44:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pride-mobility-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:44:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ag10-series-4-x-8-solid-alum-fixed-bar-supply-return-air-vent-grille-brushed-satin>: HTTP status code is not handled or not allowed
2026-01-10 20:44:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-80bs21x138-1-pitch-1-38-finished-bore-21-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-12m-gray-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ag10-series-4-x-14-solid-alum-fixed-bar-supply-return-air-vent-grille-white-matte>: HTTP status code is not handled or not allowed
2026-01-10 20:44:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lavante-trail-2-running-work-shoes-composite-toe-size-13m-gray-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acme-623-home-alarm-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-06bs18hx22-metric-38-pitch-22mm-finished-bore-18-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-shoes-composite-toe-size-8-5m-silver-gray-clay-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-al802ulada-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:44:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-50bs52x1716-58-pitch-1-716-finished-bore-52-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-d60bs23hx112-double-34-pitch-1-12-finished-bore-23-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:44:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-mid-cut-shoes-composite-toe-size-9-5m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:44:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hook-n-loop-tape-fasteners-light-gray-1-inch-x-75-feet>: HTTP status code is not handled or not allowed
2026-01-10 20:44:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hook-n-loop-tape-fasteners-black-3-8-inch-x-75-feet>: HTTP status code is not handled or not allowed
2026-01-10 20:45:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nano-x1-adventure-athletic-work-mid-cut-shoes-composite-toe-size-8w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wet-umbrella-bag-holdersign-panel>: HTTP status code is not handled or not allowed
2026-01-10 20:45:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-al400ulacm-alarm-replacement-battery-10ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:45:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lavante-trail-2-running-work-shoes-composite-toe-size-11-5w-gray-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lavante-trail-2-running-work-shoes-composite-toe-size-8w-army-green-black-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:45:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wet-umbrella-bag-holderpoly-bag-with-graphic-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:45:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-high-top-work-shoes-composite-toe-size-9m-triple-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18227-food-storage-container-tower-pp-holds-3-11-size-containers-white-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:45:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hybrid-skate-inspired-work-shoes-composite-toe-size-4m-black-tower-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:45:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floatride-energy-3-adventure-men-s-athletic-work-shoes-composite-toe-size-16m-black-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:45:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hybrid-skate-inspired-work-shoes-composite-toe-size-10w-navy-celestial-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:45:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sprocket-41bs15hx12-12-pitch-12-finished-bore-15-teeth>: HTTP status code is not handled or not allowed
2026-01-10 20:45:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-lite-emergency-light-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:45:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shoprider-777e-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:45:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/column-protector-planks-for-24-x-24-square-columns-yellow-4carton>: HTTP status code is not handled or not allowed
2026-01-10 20:45:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21410 pages (at 96 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:45:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/column-protector-round-for-24-dia-round-columns-black-3carton>: HTTP status code is not handled or not allowed
2026-01-10 20:45:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lawn-boy-lawn-and-garden-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:45:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floatride-energy-3-adventure-women-s-athletic-work-shoes-composite-toe-size-12w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/column-protector-12x-12-square-opening-24-od-x-42h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:45:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roper-863-lawn-and-garden-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:45:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boot-covers-16-polyethylene-elastic-top-2x>: HTTP status code is not handled or not allowed
2026-01-10 20:45:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toro-55150-lawn-and-garden-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:45:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotary-screw-air-compressor-wdryer-230v-140-psi-50-cfm-15hp-3ph>: HTTP status code is not handled or not allowed
2026-01-10 20:45:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/floatride-energy-3-adventure-men-s-athletic-work-shoes-composite-toe-size-3-5m-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scorpion-ytz7s-powersports-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:45:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-high-top-work-shoes-composite-toe-size-4w-triple-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-high-top-work-shoes-composite-toe-size-7-5w-triple-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-tapered-roller-bearing-e30204j-20mm-bore-47mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:45:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-tapered-roller-bearing-e32207j-35mm-bore-72mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:45:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-e-a-standard-wood-beam-socket-1845>: HTTP status code is not handled or not allowed
2026-01-10 20:45:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-tapered-roller-bearing-e32306j-30mm-bore-72mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:45:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bb4500-work-high-top-work-sneaker-composite-toe-size-9m-black-holographic-spectrum>: HTTP status code is not handled or not allowed
2026-01-10 20:45:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-work-shoes-composite-toe-size-11m-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:45:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metric-tapered-roller-bearing-e32018j-90mm-bore-140mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:45:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boreem-200cc-atv-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:45:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plastic-u-handle-803l-110-dia-black-m8-516-socket-cap-screw>: HTTP status code is not handled or not allowed
2026-01-10 20:45:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reportpro-10-pocket-project-organizer-letter-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/presstex-report-cover-prong-clip-legal-2-capacity-light-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:45:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fast-plug-10-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:45:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pressboard-report-cover-2-prong-fastener-letter-3-capacity-red>: HTTP status code is not handled or not allowed
2026-01-10 20:45:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/end-opening-pressguard-report-cover-prong-fastener-legal-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honeywell-remote-bulb-refrigeration-temp-controller-t6031a1029-30-f-to-90f-8-ft-capillary>: HTTP status code is not handled or not allowed
2026-01-10 20:45:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolve-skate-inspired-work-shoes-composite-toe-size-10-5m-rust>: HTTP status code is not handled or not allowed
2026-01-10 20:45:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/liftmaster-475-garage-door-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:45:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-slide-base-w445t>: HTTP status code is not handled or not allowed
2026-01-10 20:45:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bmw-k75s-750cc-atv-replacement-battery-1985-1987-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:45:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drw06-drawer-stacking-6-d-x-18-l-x-12-w>: HTTP status code is not handled or not allowed
2026-01-10 20:45:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motor-pewwe15-12-575-182t-prem-eff-tefc-rigid-3-ph-182t-575v-19-fla>: HTTP status code is not handled or not allowed
2026-01-10 20:45:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-lucky-duck-hen-decoy-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:45:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bb4500-work-high-top-work-sneaker-composite-toe-size-8-5w-black-holographic-spectrum>: HTTP status code is not handled or not allowed
2026-01-10 20:45:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-bottleless-cold-cooler-w-filtration-black-w-blue-trim>: HTTP status code is not handled or not allowed
2026-01-10 20:45:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bb4500-work-high-top-work-sneaker-composite-toe-size-11-5m-black-holographic-spectrum>: HTTP status code is not handled or not allowed
2026-01-10 20:45:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pm-dc-motor-wpmdc2-18-180v-145tcb-tenv-tefc-145tc-180v-2-hp-1800-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:45:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prismacolor-col-erase-pencils-blue-lead-blue-barrel>: HTTP status code is not handled or not allowed
2026-01-10 20:45:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vapor-x12-electric-scooter-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:45:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ezip-nano-electric-scooter-replacement-battery-5ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:45:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/comfortie-casual-work-shoes-steel-toe-size-6w-black-white>: HTTP status code is not handled or not allowed
2026-01-10 20:45:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-frame-motor-wwht50-18-326ts-gp-tefc-rigid-3-ph-326ts-596-fla>: HTTP status code is not handled or not allowed
2026-01-10 20:45:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/d-flange-kit-pew400td-2-prem-eff-404t-405t-2-pole>: HTTP status code is not handled or not allowed
2026-01-10 20:45:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/buell-rr1000-1000cc-motorcycle-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:45:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-fan-motor-for-48-in-portable-evaporative-cooler-604152>: HTTP status code is not handled or not allowed
2026-01-10 20:45:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cc-pump-motor-wwe15-36-215jp-tefc-rigid-c-3-ph-215jp-15-hp-3600-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:45:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/healthflex-privacy-screen-5-panel-primary-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:45:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/350-industrial-carton-sealing-tape-2-x-55-yds-clear-pack-of-36>: HTTP status code is not handled or not allowed
2026-01-10 20:45:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/abc7db-polyurethane-soft-face-dead-blow-hammer-20-l-55-lb>: HTTP status code is not handled or not allowed
2026-01-10 20:45:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pgo-comet-junior-50cc-scooter-and-moped-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:45:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/126-quiet-carton-sealing-tape-3-x-55-yds-clear-pack-of-24>: HTTP status code is not handled or not allowed
2026-01-10 20:45:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-frame-motor-wwe300-18-586-7-gp-tefc-rigid-3-ph-586-7-460v-323-fla-rb>: HTTP status code is not handled or not allowed
2026-01-10 20:45:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/302626-coat-hook-side-by-side-prongs-brushed-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:45:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cc-pump-motor-wwe25-18-284jp-tefc-rigid-c-3-ph-284jp-25-hp-1800-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:45:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-gsx-380f-377cc-snowmobile-replacement-battery-2005-2006-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:45:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-metal-foot-guards-rubber-toe-clip-rubber-strap-6w-extra-large-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:45:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/specialty-drum-dolly-for-55-gallon-drum-hard-rubber-wheels-900-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:45:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-mx-z-sport-550f-553cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:45:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mens-16-ga-steel-foot-guards-rubber-toe-clip-rubber-strap-5-12w-large-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:45:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foot-guards-rubber-strap-thermo-foam-plastic-green-5-width-one-size-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:45:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smooth-surface-squeegee-for-mr-50-steam-vacuum-261572>: HTTP status code is not handled or not allowed
2026-01-10 20:45:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-nano-lok-xl-self-retracting-lifeline-w-quick-connect-steel-rebar-lock-hook-9l>: HTTP status code is not handled or not allowed
2026-01-10 20:45:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carton-sealing-tape-if-seal-is-broken-2-x-55-yds-redwhite-pack-of-36>: HTTP status code is not handled or not allowed
2026-01-10 20:45:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apc-smart-ups-sc-620va-sc620-ups-replacement-battery-10ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:45:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-extinguisher-5-lbs-multi-purpose-dry-chemical-cosmic-5e>: HTTP status code is not handled or not allowed
2026-01-10 20:45:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdmi-to-dvi-cable-adapter-connector-hdmi-female-to-dvi-d-male>: HTTP status code is not handled or not allowed
2026-01-10 20:45:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1000ft-cat6-550mhz-gigabit-bulk-solid-pvc-cable-blue-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:45:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100pc-75-inch-nylon-cable-ties-cable-management-40lb-strength>: HTTP status code is not handled or not allowed
2026-01-10 20:45:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ft-one-fit-non-belted-full-body-harness-standard-3-d-ring-quick-connect-legs-small>: HTTP status code is not handled or not allowed
2026-01-10 20:45:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/meditek-external-lift-stairlift-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:45:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala174-nano-lok-personal-self-retracting-lifeline-w-steel-snap-anchor-hook-6l>: HTTP status code is not handled or not allowed
2026-01-10 20:45:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-purpose-metal-access-panel-cam-lock-12l-x-12w>: HTTP status code is not handled or not allowed
2026-01-10 20:45:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pace-tech-alsign-600-medical-replacement-battery-10ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:45:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fire-rated-insulated-metal-access-panel-16l-x-16w>: HTTP status code is not handled or not allowed
2026-01-10 20:45:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-ribbon-for-tcx-and-pix-series>: HTTP status code is not handled or not allowed
2026-01-10 20:45:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotary-screw-air-compressor-w-dryer-200v-140psi-16cfm-5hp-3ph-120-gal-tank>: HTTP status code is not handled or not allowed
2026-01-10 20:45:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/greenline-626-hand-truck-w-pin-handle-pneumatic-wheels-600-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:45:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotary-screw-air-compressor-230v-150psi-16cfm-5hp-3ph-120-gal-tank>: HTTP status code is not handled or not allowed
2026-01-10 20:45:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotary-screw-air-compressor-460v-150psi-16cfm-5hp-3ph-120-gal-tank>: HTTP status code is not handled or not allowed
2026-01-10 20:45:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mk-es17-12-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:45:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-els-eds6120-6v-12ah-emergency-light-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:45:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotary-screw-air-compressor-460v-125psi-185cfm-5hp-3ph-120-gal-tank>: HTTP status code is not handled or not allowed
2026-01-10 20:45:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotary-screw-air-compressor-230v-150psi-16cfm-5hp-1ph-120-gal-tank>: HTTP status code is not handled or not allowed
2026-01-10 20:45:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/epdm-commercial-grade-60a-rubber-sheet-1-8-thick-x-36-x-12-length-black>: HTTP status code is not handled or not allowed
2026-01-10 20:45:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digitech-safety-view-plus-4-tier-12-doors-box-locker-36w-x-18d-x-78h-tan-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:45:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/epdm-commercial-grade-60a-rubber-sheet-3-8-thick-x-3-x-10-length-black>: HTTP status code is not handled or not allowed
2026-01-10 20:46:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jump-n-carry-jnc100-jump-starter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:46:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/75-nonslip-coating-durable-antislip-paint-1-gal-safety-yellow-75-ye-gl>: HTTP status code is not handled or not allowed
2026-01-10 20:46:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-blade-for-katanaboy-500mm>: HTTP status code is not handled or not allowed
2026-01-10 20:46:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elk-12260-sealed-lead-acid-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:46:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cold-weather-kit-for-liquid-cooled-automatic-standby-generators-with-16-lt-engines>: HTTP status code is not handled or not allowed
2026-01-10 20:46:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-built-ii153-2-tier-2-doors-locker-12w-x-12d-x-82h-black-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:46:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-built153-1-tier-1-door-locker-12w-x-18d-x-78h-black-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:46:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/surface-mount-valve-box-prime-coated-12-12-6>: HTTP status code is not handled or not allowed
2026-01-10 20:46:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scheduled-maintenance-kit-for-ecogen-air-cooled-6-watt-530-cc-generator>: HTTP status code is not handled or not allowed
2026-01-10 20:46:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-1-tier-1-door-locker-18w-x-24d-x-78h-dark-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:46:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/100-amp-2500-watt-single-load-manual-transfer-switch>: HTTP status code is not handled or not allowed
2026-01-10 20:46:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-built153-1-tier-1-door-locker-12w-x-18d-x-78h-light-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:46:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-green-pvc-water-suction-hose-20-feet>: HTTP status code is not handled or not allowed
2026-01-10 20:46:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ready-built-ii-1-tier-3-doors-locker-36w-x-18d-x-84h-light-gray-assembled>: HTTP status code is not handled or not allowed
2026-01-10 20:46:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yellow-post-safety-barrier-11-ft-yellow-black-belt-caution-do-not-enter-w-roller-base>: HTTP status code is not handled or not allowed
2026-01-10 20:46:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21512 pages (at 102 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:46:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vent-cap-slip-mount-3-1>: HTTP status code is not handled or not allowed
2026-01-10 20:46:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/apc-smartups-1500va-lcd-rm-2u-smt1500rm2u-12v-9ah-ups-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:46:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-rack-wire-decking-58-w-x-36-d-2800-lbs-cap-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-closed-stand-alone-shelving-8-shelves-500-lb-cap-48w-x-12d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powered-drum-truck-f89484f-fiber-chime-hook-12-wheels>: HTTP status code is not handled or not allowed
2026-01-10 20:46:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mechanical-tray-scale-kilograms>: HTTP status code is not handled or not allowed
2026-01-10 20:46:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-side-base-for-locker-18w-x-18d-x-6h-light-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digital-portable-wheelchair-scale-800lb-capacity-emr-connectivity>: HTTP status code is not handled or not allowed
2026-01-10 20:46:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calm50-ta-torque-arm-for-calm-series-50mm-aluminum-worm-gear-reducer>: HTTP status code is not handled or not allowed
2026-01-10 20:46:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caterpillar-e110-industrial-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:46:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jayhawk-recycled-plastic-6-ft-brooklyn-bench-cedar>: HTTP status code is not handled or not allowed
2026-01-10 20:46:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-metal-shelving-6-shelves-starter-unit-500-lb-cap-48w-x-24d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-extra-heavy-duty-additional-shelf-36w-x-24d-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calm50-101-56c-aluminum-worm-gear-reducer-50mm-101-56c-nema-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:46:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toyo-3fm4-2-sealed-lead-acid-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:46:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/book-browser-flushback>: HTTP status code is not handled or not allowed
2026-01-10 20:46:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/calm90-501-145tc-aluminum-worm-gear-reducer-90mm-501-145tc-nema-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:46:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-closed-shelving-6-shelves-starter-unit-800-lb-cap-36w-x-12d-x-87h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-chairries-premium-tray-15-seat-height>: HTTP status code is not handled or not allowed
2026-01-10 20:46:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-chairries-premium-tray-13-seat-height>: HTTP status code is not handled or not allowed
2026-01-10 20:46:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-closed-style-metal-shelving-8-shelves-900-lb-cap-48w-x-18d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-open-shelving-8-shelves-starter-unit-500-lb-cap-36w-x-12d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1530x06-ship-cross-over-35-overall-width-6-stairs>: HTTP status code is not handled or not allowed
2026-01-10 20:46:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/northflex-cold-grip-plus-5-cut-resistant-gloves-hi-vis-orange-black-size-m-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:46:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/northflex-cold-grip-plus-5-cut-resistant-gloves-hi-vis-orange-black-size-xxl-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:46:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/crown-12ce7-5-sealed-lead-acid-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:46:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-lp12-7-2-sealed-lead-acid-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:46:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-open-stand-alone-shelving-8-shelves-375-lb-cap-48w-x-12d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-in-aluminum-hat-channel-motorized-damper>: HTTP status code is not handled or not allowed
2026-01-10 20:46:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-products-mt-st-lw1624-16-x-24-flatbed-truck-tarp-light-weight-steel-tarp>: HTTP status code is not handled or not allowed
2026-01-10 20:46:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-products-mt-lb-162700-16-x-27-flatbed-truck-tarp-lumber-tarp>: HTTP status code is not handled or not allowed
2026-01-10 20:46:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-track-cam-tie-down-strap-3000-lb-capacity-2-x-12>: HTTP status code is not handled or not allowed
2026-01-10 20:46:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-in-x-12-in-steel-door-louver>: HTTP status code is not handled or not allowed
2026-01-10 20:46:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-track-single-strap-anchor-w-carriage-bolts-stainless-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 20:46:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-products-mn-dn-2040-debris-safety-netting-20-x-40>: HTTP status code is not handled or not allowed
2026-01-10 20:46:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-open-style-shelving-sway-braces-6-shelves-36w-x-18d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-products-mn-dn-0818-debris-safety-netting-8-x-18>: HTTP status code is not handled or not allowed
2026-01-10 20:46:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-products-mn-dn-0824-debris-safety-netting-8-x-24>: HTTP status code is not handled or not allowed
2026-01-10 20:46:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-in-high-velocity-wall-exhaust-shutter>: HTTP status code is not handled or not allowed
2026-01-10 20:46:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-open-stand-alone-shelving-6-shelves-500-lb-cap-36w-x-18d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stair-tread-round-nose-36l-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shockstrap-tie-downs-ratchet-strap-3000-lb-capacity-15l-x-1-12w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:46:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hi-tech-open-stand-alone-shelving-8-shelves-500-lb-cap-36w-x-18d-x-87h-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:46:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yuasa-np26-12r-sealed-lead-acid-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:46:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/falcon-electric-sg15k-1t-sg2k-1t-sg2k-1t-hw-12v-7ah-ups-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:46:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-track-weld-on-single-strap-anchor-zinc-pack-of-10>: HTTP status code is not handled or not allowed
2026-01-10 20:46:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/century-es6000-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:46:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vision-hp6-25w-sealed-lead-acid-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:46:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cove-base-vinyl-4x18x48-charcoal>: HTTP status code is not handled or not allowed
2026-01-10 20:46:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/made-in-usa-bright-finish-jobbers-length-drill-letter-f>: HTTP status code is not handled or not allowed
2026-01-10 20:46:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reinforced-nose-hand-truck-tf-220-10-10-rubber-with-foot-kick-dual-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:46:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-track-weld-on-contoured-unfinished-single-strap-anchor>: HTTP status code is not handled or not allowed
2026-01-10 20:46:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maintenance-free-quiet-2-tier-6-doors-locker-54w-x-24d-x-78h-dark-gray-unassembled>: HTTP status code is not handled or not allowed
2026-01-10 20:46:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mighty-max-ml7-6-sealed-lead-acid-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:46:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/koyo-np1-2-12-sealed-lead-acid-replacement-battery-1-3ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:46:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pallet-dolly-pdsh4248-6ph-with-pipe-handle-solid-deck-42-x-48>: HTTP status code is not handled or not allowed
2026-01-10 20:46:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/29336e-spherical-roller-thrust-bearing-extra-capacity-bronze-cage>: HTTP status code is not handled or not allowed
2026-01-10 20:46:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/work-height-platform-truck-rnh2-3048-6mr-ah-with-lower-shelf-30-x-48-adj-height>: HTTP status code is not handled or not allowed
2026-01-10 20:46:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/test-tube-rack-for-16mm-tubes-31-places-white-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 20:46:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ldx8050-high-speed-electric-8-x-12-label-dispenser>: HTTP status code is not handled or not allowed
2026-01-10 20:46:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-rackall-model-ra18-high-temp-polysulfone-nonesd-25-slots>: HTTP status code is not handled or not allowed
2026-01-10 20:46:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-chain-hoist-w-overload-protection-20-ton-capacity-30-lift>: HTTP status code is not handled or not allowed
2026-01-10 20:46:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ld3000-fda-clean-room-electric-2-1-4w-x-3l-label-dispenser>: HTTP status code is not handled or not allowed
2026-01-10 20:46:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yuasa-npx35-250-sealed-lead-acid-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:46:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/karryall-model-80-adjustable-conductive-medium-large-pcb-rack-20w-1212d-1834h>: HTTP status code is not handled or not allowed
2026-01-10 20:46:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/micro-centrifuge-tube-20ml-capacity-amber-pack-of-500>: HTTP status code is not handled or not allowed
2026-01-10 20:46:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cryo-coder-for-skirted-base-vials-white-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:46:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-brake-winch-w-left-handed-handle-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:46:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/we302323kd-dsr-donut-screen-rack-kd-end-load-25-12w-x-24d-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:46:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n182436-2-shelving-unit-2-shelf-18w-x-24h-x-36l-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:46:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cryo-storage-box-for-10ml-18ml-vials-81-places-white-pack-of-4>: HTTP status code is not handled or not allowed
2026-01-10 20:46:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-in-6-in-black-steel-pipe-nipple-150-psi-lead-free>: HTTP status code is not handled or not allowed
2026-01-10 20:46:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/n246048-4-chl2-mobile-shelving-unit-4-shelf-24w-x-66h-x-48l-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:46:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/micro-centrifuge-tube-05ml-capacity-natural-pack-of-1000>: HTTP status code is not handled or not allowed
2026-01-10 20:46:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dynamometer-top-hook-assembly-for-9-ton-capacity-lever-hoists>: HTTP status code is not handled or not allowed
2026-01-10 20:46:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dehumidifier-w-wifi-115v-50-pint-4500-sq-ft-coverage>: HTTP status code is not handled or not allowed
2026-01-10 20:46:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eaton-powerware-pw5115-1400-usb-05146566-5591-12v-9ah-ups-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:46:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cant1860-cantilever-shelf-adjustable-solid-shelf-18w-x-2h-x-60l-aluminum>: HTTP status code is not handled or not allowed
2026-01-10 20:46:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pz2516-single-pizza-rack-24-pan-capacity-19-12w-x-73-12h-x-16d>: HTTP status code is not handled or not allowed
2026-01-10 20:46:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-smp5pmctxpd4cb-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:46:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-smp7pmctxpd4cb-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:46:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-al1024ulxpd8-alarm-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:46:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/napco-alarms-ma1000e4lb-alarm-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microfiber-cloths-16x16-blue-200-pack-csa002e>: HTTP status code is not handled or not allowed
2026-01-10 20:47:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/microfiber-cloths-16x16-red-200-pack-csa006e>: HTTP status code is not handled or not allowed
2026-01-10 20:47:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-al300ulxpd16-alarm-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:47:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/altronix-al400ulacmcb-alarm-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:47:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laboratory-tray-polypropylene-large-20l-x-17w-x-5h-white-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:47:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/astro-lay-in-ceiling-panels-shadowline-tapered-edge-24l-x-24w-white>: HTTP status code is not handled or not allowed
2026-01-10 20:47:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shepard-meyra-1986-wheelchair-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mars-acoustical-panels-shadowline-tapered-edge-24l-x-48w-white>: HTTP status code is not handled or not allowed
2026-01-10 20:47:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laboratory-scoops-pp-1000ml-capacity-white-pack-of-6>: HTTP status code is not handled or not allowed
2026-01-10 20:47:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merits-p120---feather-wheelchair-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reagent-bottle-wide-mouth-hdpe-250ml-capacity-clear-pack-of-250>: HTTP status code is not handled or not allowed
2026-01-10 20:47:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stowaway-tensabarrier-post-yellow-13-ft-black-yellow-chevron-belt>: HTTP status code is not handled or not allowed
2026-01-10 20:47:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-ii-accuflow-steel-safety-can-5-gal-5-8-metal-hose-yellow-7250220>: HTTP status code is not handled or not allowed
2026-01-10 20:47:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desiccator-glass-12-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:47:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/made-in-usa-4-flute-3-4-inch-dia-x-1-2-inch-shank-x-3-5-8-inch-oal-cobalt-single-end-mill>: HTTP status code is not handled or not allowed
2026-01-10 20:47:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6021zz-deep-groove-ball-bearing-double-shielded-105mm-bore-160mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6216zz-p53-deep-groove-ball-bearing-double-shielded-abec-5-80mm-bore-140mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desiccator-vacuum-white-base-polypropylenepolycarbonate-10-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:47:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21613 pages (at 101 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:47:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6024zz-deep-groove-ball-bearing-double-shielded-120mm-bore-180mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leisure-lift-u1-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-rehab-p200-wheelchair-replacement-battery-5ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:47:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/622022rs-deep-groove-ball-bearing-wide-width-double-sealed-15mm-bore-35mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6317-deep-groove-ball-bearing-open-85mm-bore-180mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bungee-cords-general-purpose-3-8-inch-x-30-inch-10-pack-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:47:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vector-pediatric-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drench-shower-wall-mount-galvanized-pipe-nylon-6-showerhead-20-gpm-120v>: HTTP status code is not handled or not allowed
2026-01-10 20:47:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6310-deep-groove-ball-bearing-open-50mm-bore-110mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wardrobe-z-locker-w-padlock-hasp-2-tier-assembled-18w-x-18d-x-60h-deep-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:47:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ortho-kinetics-pony-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merits-s341-deluxe-wheelchair-replacement-battery-75ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/test-tube-rack-for-13-16mm-tubes-24-places-wire-epoxy-coated-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:47:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cyclone-2057-pack-12-mylar-shields>: HTTP status code is not handled or not allowed
2026-01-10 20:47:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/63022rs-p53-deep-groove-ball-bearing-double-sealed-abec-5-15mm-bore-42mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-rehab-f35-r2-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-patrol-sla1116-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pride-mobility-614-hd-wheelchair-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aerial-shelf-for-bench-22648gy-office-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:47:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6218-deep-groove-ball-bearing-open-90mm-bore-160mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62162rsnr-deep-groove-ball-bearing-double-sealed-snap-ring-80mm-bore-140mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6303zz-p53-deep-groove-ball-bearing-double-shielded-abec-5-17mm-bore-47mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62022rsnr-deep-groove-ball-bearing-double-sealed-snap-ring-15mm-bore-35mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-electric-vibrator-mve-3308-900rpm-3-phase-60hz-230460v-8pole>: HTTP status code is not handled or not allowed
2026-01-10 20:47:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6208zz-p53-deep-groove-ball-bearing-double-shielded-abec-5-40mm-bore-80mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6315-deep-groove-ball-bearing-open-75mm-bore-160mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-electric-vibrator-mve-050-dc-24-3000rpm-single-phase-24v-dc>: HTTP status code is not handled or not allowed
2026-01-10 20:47:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pneumatic-vibrator-turbine-ot-20-anodized-aluminum-body>: HTTP status code is not handled or not allowed
2026-01-10 20:47:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-electric-vibrator-mve-1602m-3600rpm-single-phase-60hz-115v-2pole>: HTTP status code is not handled or not allowed
2026-01-10 20:47:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/invacare-action-xt-wheelchair-replacement-battery-75ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-72l-x-14w-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:47:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/type-1-fiberglass-step-ladder-4-ft-dxl311004>: HTTP status code is not handled or not allowed
2026-01-10 20:47:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/roper-532048068-lawn-and-garden-replacement-battery-1-3ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-cart-black-epoxy-36l-x-14w-x-40h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:47:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60032rs-deep-groove-ball-bearing-double-sealed-17mm-bore-35mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-36l-x-18w-x-60h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:47:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-54l-x-24w-x-69h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:47:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/62022rs-p53-deep-groove-ball-bearing-double-sealed-abec-5-15mm-bore-35mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:47:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pen-style-highlighter-chisel-tip-fluorescent-pink-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:47:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/agco-allis-517h-lawn-and-garden-replacement-battery-3-2ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-cart-black-epoxy-72l-x-24w-x-40h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:47:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gilson-53037-lawn-and-garden-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-60l-x-14w-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:47:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sears-256576-lawn-and-garden-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-72l-x-18w-x-60h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:47:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-72l-x-14w-x-80h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:47:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ihc-cub-garden-702-lawn-and-garden-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-black-epoxy-wire-shelf-truck-30l-x-14w-x-69h-polyurethane-brake-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:47:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cylindrical-bearing-double-row-bore-60mm-0020-to-0035-radial-clearance-nn3012m2kc1nap4>: HTTP status code is not handled or not allowed
2026-01-10 20:47:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simplicity-4208-lawn-and-garden-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/energel-liquid-retractable-gel-ink-pen-metal-tip-refillable-07mm-red-ink>: HTTP status code is not handled or not allowed
2026-01-10 20:47:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunworks-groundwood-construction-paper-12x9-violet-50-sheets>: HTTP status code is not handled or not allowed
2026-01-10 20:47:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/astralite-eu-mr-3r-emergency-light-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dr-grip-center-of-gravity-ballpoint-retractable-pen-medium-pink-barrel-black-ink>: HTTP status code is not handled or not allowed
2026-01-10 20:47:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-cargo-pant-black-40x32-pt88>: HTTP status code is not handled or not allowed
2026-01-10 20:47:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/visavis-weterase-overhead-transparency-marker-fine-red-ink-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:47:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/utility-uniform-pant-navy-42x32-pt62>: HTTP status code is not handled or not allowed
2026-01-10 20:47:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8020-25-series-1-x-1-four-t-slotted-extrusion-profile-238-316l-stock-bar>: HTTP status code is not handled or not allowed
2026-01-10 20:47:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-80-153-emergency-light-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precise-grip-rolling-ball-pen-extra-fine-05mm-black-barrelink>: HTTP status code is not handled or not allowed
2026-01-10 20:47:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60070002294-461x-8-1-2w-x-11l-m30-grit>: HTTP status code is not handled or not allowed
2026-01-10 20:47:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/petropad153-smart-polymer-spill-pad-27-316l-x-35-38w-medium-white-pk-of-5>: HTTP status code is not handled or not allowed
2026-01-10 20:47:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60070005180-261x-8-1-2w-x-11l-m12-grit>: HTTP status code is not handled or not allowed
2026-01-10 20:47:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/petropad153-smart-polymer-spill-pad-35-1316l-x-53-78w-large-white-pk-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:47:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toro-212-12-hp-lawn-and-garden-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/247-highlighter-chisel-tip-yellow-ink-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:47:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/york-wide-light-ar-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scag-stz52-20kh-lawn-and-garden-replacement-battery-8ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:47:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/energel-retractable-gel-pen-07mm-metal-tip-violet-ink-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:47:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-outdoor-800-lawn-and-garden-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/energel-liquid-gel-refill-05mm-needle-tip-blue-ink>: HTTP status code is not handled or not allowed
2026-01-10 20:47:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8588-tool-post-grinder-series-57-1hp>: HTTP status code is not handled or not allowed
2026-01-10 20:47:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/big-beam-2rl6s10ph-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lightalarms-2s12e3-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bisley-x--back-womens-long-sleeve-shirt-class-3-s-hi-vis-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:47:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/precise-v5-rt-rolling-ball-retractable-pen-extra-fine-05mm-red-barrelink>: HTTP status code is not handled or not allowed
2026-01-10 20:47:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-agi5hp-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:47:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/better-retractable-ballpoint-pen-refillable-nonslip-grip-medium-black-ink-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:47:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g2-gel-retractable-rollerball-pen-bold-10mm-black-ink-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:47:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dyna-ray-12dr707-emergency-light-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:47:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/battery-voltage-regulator-for-12vdc-systems-including-lithium-100-amp>: HTTP status code is not handled or not allowed
2026-01-10 20:47:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pure-sine-inverter-charger-w-50a-bypass-3000-watt-120vac-250-amp>: HTTP status code is not handled or not allowed
2026-01-10 20:47:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g2-gel-retractable-rollerball-pen-extra-fine-05mm-black-ink-dozen>: HTTP status code is not handled or not allowed
2026-01-10 20:48:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/light-duty-no-bump-dump-hopper-steel-3-cu-yd-2000-lb-capacity-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:48:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-acting-hydraulic-cylinder-h2502-25-ton-2-stroke>: HTTP status code is not handled or not allowed
2026-01-10 20:48:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dyna-ray-2s18161-emergency-light-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:48:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/medium-duty-no-bump-dump-hopper-steel-3-cu-yd-4000-lb-capacity-soda-red>: HTTP status code is not handled or not allowed
2026-01-10 20:48:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-source-emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-mesh-divider-dmb560-570c-for-qmb560c-qmb570c-each>: HTTP status code is not handled or not allowed
2026-01-10 20:48:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zimmer-ats-750-tourniquet-12v-12ah-medical-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parks-medical-doppler-811b-12v-12ah-medical-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sumostance-extension-ladder-w-hyperlite-cable-hooks-claw-32-type-iaa-375-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:48:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lithonia-ind616-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/18-solvent-resistant-paint-tray-12-case-pet-1800>: HTTP status code is not handled or not allowed
2026-01-10 20:48:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/touch-up-kit-24-case-314-a38t>: HTTP status code is not handled or not allowed
2026-01-10 20:48:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/king-kombo-combination-ladder-w-grip-n-go-hinge-5-type-iaa-4-step-375-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:48:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mpsr1-d45wx-ge-single-action-cat-45-key-reset-explosionproof>: HTTP status code is not handled or not allowed
2026-01-10 20:48:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hyperlite-extension-ladder-w-cable-hooks-v-rung-28-type-iaa-375-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:48:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21711 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:48:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sd-trm4-remote-testreset-station-magnetic-4w-reed>: HTTP status code is not handled or not allowed
2026-01-10 20:48:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6x3-4-dralon-woven-mini-roller-cover-refill-12-pack-5-case-6wv075-12>: HTTP status code is not handled or not allowed
2026-01-10 20:48:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-lm40i-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/439dex-6aw-adaptabel174-dc-vibrating-fire-alarm-bell-explosion-proof-6>: HTTP status code is not handled or not allowed
2026-01-10 20:48:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dyna-ray-b6v4-emergency-light-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:48:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/johnlite-2950-emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sd-rj5-rj45-wiring-harness-5>: HTTP status code is not handled or not allowed
2026-01-10 20:48:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dyna-ray-dr2200-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dark-horse-20-articulated-extendable-ladder-fiberglass-5-type-ia-300-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:48:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/king-kombo-professional-combination-ladder-6-type-ia-5-step-300-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:48:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/extension-ladder-w-ground-cue-sure-set-32-type-iaa-375-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:48:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triple-tap-extension-cord-sl800-retractable-reel-30l-cord-163-ga-yw-4pk>: HTTP status code is not handled or not allowed
2026-01-10 20:48:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-lm66-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powersonic-ps121000u-12v-100ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ritar-rt650-6v-5ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clip-bin-front-36-inch-w-x-3-inch-h-champagne>: HTTP status code is not handled or not allowed
2026-01-10 20:48:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clip-label-holder-24-inch-w-champagne>: HTTP status code is not handled or not allowed
2026-01-10 20:48:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunnyway-sw670-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orbital-auto-floor-scrubber-with-traction-drive-34-in-cleaning-path>: HTTP status code is not handled or not allowed
2026-01-10 20:48:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sentry-lite-3904-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/maintenance-pro153-hutchcanopy-53-12w-x-24-78d-x-24h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:48:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parasystems-ps640-6v-45ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sure-lites-1503-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlake-bulk-storage-rack-upright-96-inch-h-x-30-inch-d-8-489-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:48:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/csb-gh1213-12v-12ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/interlake-bulk-storage-rack-upright-144-inch-h-x-24-inch-d-8-489-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:48:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-stage-duplex-air-compressor-20-hp-120-gal-capacity-175-psi-3-phase-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:48:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sure-lites-6-119-emergency-light-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kung-long-wp7212-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wire-panel-3w-x-10h>: HTTP status code is not handled or not allowed
2026-01-10 20:48:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-120793-emergency-light-replacement-battery-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enersys-np712tfr-12v-7ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/casil-ca1212-12v-12ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k2000-5-drawer-hang-on-side-cabinet-13-58w-x-20d-x-29-116h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:48:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/iron-two-stage-air-compressor-10-hp-120-gal-capacity-3-phase-230v-830-lb-wt>: HTTP status code is not handled or not allowed
2026-01-10 20:48:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-stage-electric-air-compressor-5-hp-80-gal-cap-3-phase-460v-481-lb-wt>: HTTP status code is not handled or not allowed
2026-01-10 20:48:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yuntong-yt645-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reception-tables-side-c-table-w-laminate-top-22-1-4wx15-3-4dx25-1-2h-maple>: HTTP status code is not handled or not allowed
2026-01-10 20:48:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/astral-square-umbrella-w-centerpost-196w-x-196d-x-114h-pacific-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:48:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/technacell-ep31-emergency-light-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:48:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-lever-passage-brushed-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:48:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mk-es1712-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-mg8-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leoch-lp1255-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-cvec15i-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/round-base-w-wheels-for-libra-cast-aluminum-100-lb-weight-black>: HTTP status code is not handled or not allowed
2026-01-10 20:48:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enersys-npx50-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kung-long-lw650-6v-5ah-sealed-lead-acid-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eagle-picher-cf6v10-sealed-lead-acid-agm-vrla-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:48:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/astral-octagon-umbrella-w-centerpost-sunbrella-awning-196w-x-196d-x-110h-logo-red>: HTTP status code is not handled or not allowed
2026-01-10 20:48:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/framed-view-binder-with-one-touch-ezd-rings-3inch-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 20:48:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orion-square-umbrella-w-sidepost-sunbrella-awning-105w-x-105d-x-111h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:48:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/big-beam-hbl6s5-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tabloid-heavy-duty-view-binder-slant-ring-2inch-capacity-11-x-17-white>: HTTP status code is not handled or not allowed
2026-01-10 20:48:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sure-lites-l2650-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3665-anchor-fastener>: HTTP status code is not handled or not allowed
2026-01-10 20:48:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2337-triangular-top-plate-caster-swivel-wbrake>: HTTP status code is not handled or not allowed
2026-01-10 20:48:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2565-45-degree-support-6l>: HTTP status code is not handled or not allowed
2026-01-10 20:48:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2566-45-degree-support-6l>: HTTP status code is not handled or not allowed
2026-01-10 20:48:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-lm24ich-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-csm54-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mri-cayman-lab-island-cart-47-78l-x-23-78w-x-34-78h-white>: HTTP status code is not handled or not allowed
2026-01-10 20:48:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-jacket-collared-knit-cuff-light-blue-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:48:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-lm40i--emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-lm68d--emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-key-depository-safe-6w-x-12d-x-6h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:48:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/13025-self-aligning-slidein-tnut>: HTTP status code is not handled or not allowed
2026-01-10 20:48:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3369-butt-fastener>: HTTP status code is not handled or not allowed
2026-01-10 20:48:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-6lsm4-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/compact-cart-w-blue-drawers-14-38l-x-18-18w-x-27-34h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:48:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/puller-with-2-swiveling-jaws-11-ton-capacity-15-34-opening-15-34-adjustable-reach>: HTTP status code is not handled or not allowed
2026-01-10 20:48:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-performance-puller-with-3-jaws-22-ton-capacity-20-12-opening-19-34-reach>: HTTP status code is not handled or not allowed
2026-01-10 20:48:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-waist-length-lab-coat-snap-cuff-light-blue-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:48:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/teledyne-2rl6s5r-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6523-double-flange-linear-bearing-brake-kit-ready>: HTTP status code is not handled or not allowed
2026-01-10 20:48:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hydraulic-high-performance-puller-with-3-jaws-165-ton-cap-14-34-opening-7-78-reach>: HTTP status code is not handled or not allowed
2026-01-10 20:48:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dual-lite-120255-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/300-watt-pure-sine-power-inverter-with-cables-pwri30012s>: HTTP status code is not handled or not allowed
2026-01-10 20:48:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3660-anchor-fastener>: HTTP status code is not handled or not allowed
2026-01-10 20:48:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portalac-gs-pwl7-emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5035-drawn-precision-aluminum-tube-profile>: HTTP status code is not handled or not allowed
2026-01-10 20:48:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/big-beam-h2et12s7-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:48:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96-w-x-36-d-production-workbench-w-drawer-upright-shelf-birch-butcher-block-square-edge-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:48:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5005-ground-and-polished-steel-tube-profile>: HTTP status code is not handled or not allowed
2026-01-10 20:49:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truck-drivers-shut-off-engine-sign-adhesive-vinyl-10-x-14-blackgreenwhite>: HTTP status code is not handled or not allowed
2026-01-10 20:49:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/panasonic-lcr064r5p-6v-4ah-security-system-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:49:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truck-drivers-all-dropped-trailers-must-be-chocked--secured-sign-plastic-10-x-14>: HTTP status code is not handled or not allowed
2026-01-10 20:49:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6092-metric-ball-end-power-bit-6mm>: HTTP status code is not handled or not allowed
2026-01-10 20:49:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caution-this-vehicle-makes-wide-right-turns-sign-graphic-dura-vinyl-14-x-10-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:49:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6131-access-hole-drills>: HTTP status code is not handled or not allowed
2026-01-10 20:49:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/notice-truck-drivers-must-wait-in-this-area-sign-vinyl-10-x-14-bluewhite>: HTTP status code is not handled or not allowed
2026-01-10 20:49:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portalac-lac-pe7f1-emergency-light-replacement-battery-7ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:49:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-tsm36-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:49:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/notice-no-drivers-beyond-this-point-sign-plastic-10-x-14-blackbluewhite>: HTTP status code is not handled or not allowed
2026-01-10 20:49:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerp003s-20-ner-electric-hoist-push-trolley-14-ton-20-lift-36-ftmin-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:49:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3362-anchor-fastener>: HTTP status code is not handled or not allowed
2026-01-10 20:49:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dog-waste-transmits-disease-contaminates-drinking-water-sign-plastic-18-x-12-green>: HTTP status code is not handled or not allowed
2026-01-10 20:49:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerp020sd-10-ner-electric-hoist-push-trolley-2-ton-10-lift-2845-ftmin-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:49:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cannondale-glamis-440cc-atv-replacement-battery-2002-2003-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/please-clean-up-after-your-pet-safety-sign-adhesive-vinyl-18-x-12-whitegreen>: HTTP status code is not handled or not allowed
2026-01-10 20:49:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21811 pages (at 100 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:49:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4150-4-hole-90-joining-plate-2l>: HTTP status code is not handled or not allowed
2026-01-10 20:49:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/moto-guzzi-targa-750cc-motorcycle-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5850-double-shaft-mounting-block-1>: HTTP status code is not handled or not allowed
2026-01-10 20:49:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ion-audio-explorer-ipa76s-speaker-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:49:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caution-this-truck-makes-wide-right-turns-sign-reflective-sheet-4-x-24-blackyellow>: HTTP status code is not handled or not allowed
2026-01-10 20:49:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2650-alucobest-panel-platinum>: HTTP status code is not handled or not allowed
2026-01-10 20:49:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oversize-load-hinged-transportation-sign-aluminum-18-x-84-blackyellow>: HTTP status code is not handled or not allowed
2026-01-10 20:49:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ner005s-10-ner-electric-hoist-hook-suspension-12-ton-10-lift-29-ftmin-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:49:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ner015sd-15-ner-dual-speed-electric-chain-hoist-1-12-ton-15-lift-183-ftmin-208v>: HTTP status code is not handled or not allowed
2026-01-10 20:49:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/womens-contoured-pullover-sweatshirt-class-3-s-hi-vis-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:49:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/parklet-with-8-panels-powdercoat-wire-mesh-panel-insert-212l-x-104w-x-44h>: HTTP status code is not handled or not allowed
2026-01-10 20:49:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ner001h-20-ner-electric-hoist-hook-suspension-18-ton-20-lift-55-ftmin-208v>: HTTP status code is not handled or not allowed
2026-01-10 20:49:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/powermatic-64b-table-saw-175-hp-115230v-50-fence-riving-knife>: HTTP status code is not handled or not allowed
2026-01-10 20:49:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8275-hi-vis-thermal-workwear-jacket-type-r-ansi-class-2-l-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:49:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ner020l-fg-10-ner-food-grade-hoist-2-ton-capacity-208v>: HTTP status code is not handled or not allowed
2026-01-10 20:49:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gate-closed-to--semi-custom-sign-egp-aluminum-18-x-24-blackwhite>: HTTP status code is not handled or not allowed
2026-01-10 20:49:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/atk-50-mxlq-50cc-motorcycle-replacement-battery-2003-2005-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7218bmuc3-angular-contact-ball-bearing-flush-ground-90mm-bore-x-160mm-od-x-30mm-w>: HTTP status code is not handled or not allowed
2026-01-10 20:49:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-tricker---250cc-motorcycle-replacement-battery-2010-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/retaining-magnet-assembly-thru-hole-126-dia-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:49:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/contoured-surveyors-vest-w-solid-front--mesh-back-class-3-xl-hi-vis-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:49:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honda-crf230l-230cc-motorcycle-replacement-battery-2014-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/concrete-saver-cleaning-etching-solution-108402>: HTTP status code is not handled or not allowed
2026-01-10 20:49:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-fxr3-1340cc-motorcycle-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-mobile-utility-table-20-x-16-undershelf-guardrail--4-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:49:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aprilia-sr-125-125cc-motorcycle-replacement-battery-1999-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c9578-system-250-voc-coal-tar-epoxy-coal-tar-epoxy-c9578402>: HTTP status code is not handled or not allowed
2026-01-10 20:49:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/razor-e200-electric-scooter-replacement-battery-8ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:49:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pgo-galaxy-25cc-scooter-and-moped-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/made-in-usa-17-32-inch-reduced-shank-extra-long-drill-bit-12-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:49:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rascal-301pc-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:49:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/forklift-karrier-55-gallon-capacity-2500-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:49:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fortress-2200fs-mobility-scooter-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:49:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nerp003hd-20-ner-electric-hoist-push-trolley-14-ton-20-lift-539-ftmin-230v>: HTTP status code is not handled or not allowed
2026-01-10 20:49:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/help-conserve-energy-turn-off-lights-when-leaving-label-vinyl-3-12-x-5-pk-of-5>: HTTP status code is not handled or not allowed
2026-01-10 20:49:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pailpro-below-hook-5-gallon-pail-karrier-200-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:49:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-mobile-utility-table-20-x-16-undershelf-304-grade>: HTTP status code is not handled or not allowed
2026-01-10 20:49:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60020010256-roll-661x-1-1-2w-x-50l-x-m15>: HTTP status code is not handled or not allowed
2026-01-10 20:49:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-12-channel-autoclavable-pipettor-71311312-50-300ul>: HTTP status code is not handled or not allowed
2026-01-10 20:49:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rascal-rover-mobility-scooter-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:49:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/plus-autoclavable-pipettor-71311109-20-200ul>: HTTP status code is not handled or not allowed
2026-01-10 20:49:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/neodymium-telescoping-magnetic-pickup-pointer-07228bulk>: HTTP status code is not handled or not allowed
2026-01-10 20:49:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/g-tek-polykor-seamless-knit-blended-cr-gloves-nitrile-coated-ansi-a5-xs-black-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:49:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foam-tube-insert-18900022-test-tubes-12mm-requires-universal-adapter>: HTTP status code is not handled or not allowed
2026-01-10 20:49:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-scratch-semi-rimless-safety-glasses-gray-lens-red-frame-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 20:49:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smartwave-radiant-electric-heater-4500w-208v-61l-x-6-716w-x-12-58h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:49:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pgo-g-max-125-125cc-scooter-and-moped-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ceramic-rectangular-base-magnets-hmks-c-with-knob-38-lbs-pull-blue-powder-coat>: HTTP status code is not handled or not allowed
2026-01-10 20:49:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/full-safety-knee-boots-steel-toe-size-4-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:49:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dalton-epower-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:49:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/anti-scratch-semi-rimless-safety-glasses-amber-lens-camouflage-frame-pack-of-12>: HTTP status code is not handled or not allowed
2026-01-10 20:49:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-x-96-slatwall-panel-mirror-with-aluminum-inserts-pkg-qty-4>: HTTP status code is not handled or not allowed
2026-01-10 20:49:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-x-48-slatwall-panel-almond-laminate-without-inserts-pkg-qty-4>: HTTP status code is not handled or not allowed
2026-01-10 20:49:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/loop-tape-individual-strips-with-adhesive-75l-x-34w-black>: HTTP status code is not handled or not allowed
2026-01-10 20:49:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-x-96-slatwall-panel-maple-veneer-without-inserts-pkg-qty-4>: HTTP status code is not handled or not allowed
2026-01-10 20:49:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-mx-z-sport-600-carb-600cc-snowmobile-replacement-battery-2012-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:49:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acifort-metmax-full-safety-boots-cleated-outsole-steel-toe-size-10-15h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:49:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-expedition-se-ace-900-900cc-snowmobile-replacement-battery-2015-2018-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:49:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/inkjet-matte-coated-note-card-5-1-2-inch-x-4-1-4-inch-matte-white-60-cards-box>: HTTP status code is not handled or not allowed
2026-01-10 20:49:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/five-star-5-subject-advance-notebook-8-1-2-inch-x-11-inch-college-ruled-200-sheets-pad>: HTTP status code is not handled or not allowed
2026-01-10 20:49:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-wide-series-refrigerator-freezer-comb-lhd-solid-door-53-cu-ft-capacity-white>: HTTP status code is not handled or not allowed
2026-01-10 20:49:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fore-mp-colors-paper-8-1-2-inch-x-11-inch-20-lb-salmon-500-sheets-ream>: HTTP status code is not handled or not allowed
2026-01-10 20:49:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tidal-mp-paper-8-1-2-inch-x-11-inch-20-lb-white-5000-sheets-carton>: HTTP status code is not handled or not allowed
2026-01-10 20:49:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/exact-vellum-bristol-paper-8-1-2-inch-x-11-inch-67-lb-vellum-white-250-sheets-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:49:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42-graphite-nebula-round-table-w-4-chair-set-in-natural-finish>: HTTP status code is not handled or not allowed
2026-01-10 20:49:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/seating-2300-series-31h-poly-stack-multi-purpose-chair-with-perforated-back-lime-green>: HTTP status code is not handled or not allowed
2026-01-10 20:49:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/varidyne-500-22e-vacuum-controller-medical-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:49:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acifort-metmax-full-safety-boots-cleated-outsole-steel-toe-size-6-16h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:49:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/biodex-medical-systems-deluxe-c-arm-table-056-004-medical-battery-26ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:49:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/acifort-metmax-full-safety-boots-cleated-outsole-steel-toe-size-9-15h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:49:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-number-10-40-tpi-h3-spiral-point-plug-chamfer-hss-tap>: HTTP status code is not handled or not allowed
2026-01-10 20:49:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hook-tape-individual-dots-with-adhesive-1-78l-x-1-78w-black-pack-of-450>: HTTP status code is not handled or not allowed
2026-01-10 20:49:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-pulley-hand-tap-1-4-20-6-inch-oal>: HTTP status code is not handled or not allowed
2026-01-10 20:49:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/index-maker-easy-apply-clear-label-divider-blank-85x11-8-tabs-5-sets-white-white>: HTTP status code is not handled or not allowed
2026-01-10 20:49:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/index-maker-easy-apply-clear-label-divider-blank-85x11-8-tabs-5-sets-plastic-multi>: HTTP status code is not handled or not allowed
2026-01-10 20:49:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/first-aid-handbook>: HTTP status code is not handled or not allowed
2026-01-10 20:49:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cotton-tip-applicator-3-in-100-vial>: HTTP status code is not handled or not allowed
2026-01-10 20:49:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snugboot-pioneer-safety-knee-boots-cleated-outsole-plain-toe-size-9-16h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:49:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/13-ft-stage-guardrail-sgr13gb>: HTTP status code is not handled or not allowed
2026-01-10 20:49:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glass-316-dia-round-for-30-round-racks-temper-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:49:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/schumacher-electric-psj-3612-jump-starter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:49:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/schumacher-electric-psj-4424-jump-starter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:49:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/guard-straight-railing-kit-120l-x-42h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:49:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dome-railing-kit-for-skylight-protection-96l-x-96w-x-42h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:50:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/office-essentials-economy-insertable-tab-divider-85x11-5-tabs-buff-multicolor>: HTTP status code is not handled or not allowed
2026-01-10 20:50:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stackable-shelf-bin-8-1-4w-x-14d-x-7h-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:50:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/big-tab-plastic-insertable-divider-print-on-8-tabs-multicolor-multicolor>: HTTP status code is not handled or not allowed
2026-01-10 20:50:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-edge-o-dock-leveler-66-ramp-width-steel-25000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:50:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-source-wp5-12-91-300-sealed-lead-acid-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:50:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bright-way-group-bw-12180-sealed-lead-acid-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-carousel-48-diameter-6000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:50:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mastercare-patient-equipment-x-250-rev-a-medical-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:50:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wheel-chock-with-rope-rubber-8l-x-5w-x-4-18h>: HTTP status code is not handled or not allowed
2026-01-10 20:50:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/picker-international-explorer-portable-x-ray-medical-replacement-battery-26ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:50:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/douglas-guardian-dg6-5f-sealed-lead-acid-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:50:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-pocket-drawer-organizer-plastic-tray-10l-x-3w-x-14h>: HTTP status code is not handled or not allowed
2026-01-10 20:50:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shallow-4-slot-drawer-organizer-plastic-tray-13-1-2l-x-1-3-4w-x-9h>: HTTP status code is not handled or not allowed
2026-01-10 20:50:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-4vs-millacu-rite-200s-drox-y-axis-powerfeeds-power-draw-bar>: HTTP status code is not handled or not allowed
2026-01-10 20:50:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-1050-mill3-axis-newall-dp700-dro-powerfeeds-power-draw-bar>: HTTP status code is not handled or not allowed
2026-01-10 20:50:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-bin-station-w-5-fixed-compartments-1-shelf-12w-x-15-7-8d-x-10-1-8h>: HTTP status code is not handled or not allowed
2026-01-10 20:50:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jtm-4vs-mill3-axis-acu-rite-vue-dro-powerfeeds>: HTTP status code is not handled or not allowed
2026-01-10 20:50:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 21912 pages (at 101 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:50:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sweatshirt-hivis-lime-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:50:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/activecare-medical-ex1420-21ah-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yov-445-4-12-apprentice-series-utility-bench-vise>: HTTP status code is not handled or not allowed
2026-01-10 20:50:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/950-0004-950-case-228l-x-183w-x-117h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:50:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-nestable-shelf-bin-4-1-8w-x-17-7-8d-x-6h>: HTTP status code is not handled or not allowed
2026-01-10 20:50:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/960-1003-960-case-w-foam-254l-x-200w-x-145h-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:50:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leisure-lift-m1-m1-pbr-m2-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clear-super-size-11w-x-23-7-8d-x-7h>: HTTP status code is not handled or not allowed
2026-01-10 20:50:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/935-1004-935-case-w-foam-220l-x-140w-x-90h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:50:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/everest-jennings-lancer-2000-wheelchair-replacement-battery-75ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/935-1007-935-case-w-foam-220l-x-140w-x-90h-graphite>: HTTP status code is not handled or not allowed
2026-01-10 20:50:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bright-way-group-bw-12260-nb-sealed-lead-acid-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/country-home-products-whisper-lite-sealed-lead-acid-replacement-battery-22ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:50:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-style-threaded-conduit-body-w-cover-and-gasket-2-size>: HTTP status code is not handled or not allowed
2026-01-10 20:50:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/20-ft-type-1a-fiberglass-d-rung-straight-ladder-d6220-1>: HTTP status code is not handled or not allowed
2026-01-10 20:50:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-stabilizer-ac96>: HTTP status code is not handled or not allowed
2026-01-10 20:50:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/straight-insulated-liquid-tight-connector-alloy-steel-1-12-size-5-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:50:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rascal-301pc-305-318pc-400t-410pc-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ef-ct-fr-cargo-pocket-work-pants-plc2-navy-9-oz-size-44-x-36u>: HTTP status code is not handled or not allowed
2026-01-10 20:50:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-person-stage-24-inch-w-x-36-ft-l-3136>: HTTP status code is not handled or not allowed
2026-01-10 20:50:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pacesaver-plus-iii-junior-plus-3-junior-wheelchair-replacement-battery-75ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:50:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optiway-technology-2000-mini-22nf-wheelchair-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-person-stage-28-inch-w-x-12-ft-l-3212>: HTTP status code is not handled or not allowed
2026-01-10 20:50:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lr-threaded-conduit-body-w-cover-and-gasket-3-12-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lr-threaded-conduit-body-w-cover-and-gasket-3-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ef-flame-resistant-classic-coverall-cec2-navy-size-46-regular>: HTTP status code is not handled or not allowed
2026-01-10 20:50:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/amigo-mobility-rt-express-junior-wheelchair-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/golden-technologies-alante-junior-gp200-wheelchair-replacement-battery-22ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:50:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ef-ct-flame-resistant-universal-fit-snap-on-hood-hlh2-navy-size-m>: HTTP status code is not handled or not allowed
2026-01-10 20:50:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toggle-anchor-8-size-white-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toggle-anchor-10-size-white-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/threaded-conduit-body-w-cover-and-gasket-12-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nsf-37-certified-air-curtain-42-inch-w-door-120v-3-4hp-1-ph-stainless-steel>: HTTP status code is not handled or not allowed
2026-01-10 20:50:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/armored-ground-clamp-bronze-12-1-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ef-ct-fr-dress-uniform-shirt-slu2-khaki-size-m-regular>: HTTP status code is not handled or not allowed
2026-01-10 20:50:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s20240b-infrared-heater-20-kw-208240v-black>: HTTP status code is not handled or not allowed
2026-01-10 20:50:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/offset-nipple-2-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tower-climbing-harness-1113190-front-back-side-d-rings-s>: HTTP status code is not handled or not allowed
2026-01-10 20:50:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kpex-9r-471-901-3-screw-extractor-double-edged-set-5-parts-size-1-5-in-metal-case>: HTTP status code is not handled or not allowed
2026-01-10 20:50:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kpex-71-22-200-sba-angeled-high-leverage-cobolt-bolt-cutters-comfort-grip-8-oal>: HTTP status code is not handled or not allowed
2026-01-10 20:50:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conical-anchor-kit-w-combo-pan-head-screw-6-size-tuff-pack-201-pieces>: HTTP status code is not handled or not allowed
2026-01-10 20:50:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pride-mobility-jazzy-1100-with-power-seat-wheelchair-replacement-battery-55ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:50:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stair-tread-with-bar-abrasive-bstsb-p3e-72-extrudedaluminum-72w-x-3d>: HTTP status code is not handled or not allowed
2026-01-10 20:50:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotating-multidirectional-machine-dolly-4400-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:50:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mz-series-mezzanine-pivot-safety-gate-fits-clear-opening-113-w-x-42-h-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 20:50:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-salvage-transport-overpack-drum-30-gallon-open-head-987378>: HTTP status code is not handled or not allowed
2026-01-10 20:50:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screw-hook-carbon-steel-6-size-100-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:50:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5501-moisture-wicking-short-sleeve-safety-tshirt-with-chest-pocket-lime-medium>: HTTP status code is not handled or not allowed
2026-01-10 20:50:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/murray-16hp-42-16-hp-35ah-lawn-and-garden-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1501-multipurpose-class-2-two-tone-mesh-zipper-6-pockets-vest-lime-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:50:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/garden-way-garden-way-55295-lawn-and-garden-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:50:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/friendly-robotics-robomower-rm400-automaticlawnmower-lawn-and-garden-battery-12ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:50:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pacesaver-eclipse-premier-titan-4-wheel-wheelchair-replacement-battery-35ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:50:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pull-rope-polypropylene-12-x-1200-size>: HTTP status code is not handled or not allowed
2026-01-10 20:50:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1005-standard-class-2-two-tone-mesh-zipper-safety-vest-lime-large>: HTTP status code is not handled or not allowed
2026-01-10 20:50:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-mobility-600c-indoor-scooter-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1502-multipurpose-class-2-two-tone-mesh-zipper-6-pockets-vest-orange-large>: HTTP status code is not handled or not allowed
2026-01-10 20:50:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polyethylene-button-head-drive-anchor-kit-w-pin-14-x-1-size-100-pieces>: HTTP status code is not handled or not allowed
2026-01-10 20:50:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/golden-technologies-gt-compass-gp-600-wheelchair-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/phillips-and-square-flat-head-machine-screw-14-20-x-1-14-size-pack-od-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-a212-24-0g5-emergency-light-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pacesaver-plus-iii-atlas-plus-3-atlas-wheelchair-replacement-battery-75ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:50:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1502-multipurpose-class-2-two-tone-mesh-zipper-6-pockets-vest-orange-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:50:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibration-mount-1-tapped-hole-1-threaded-stud-118-inch-dia-40mm-h-m8-x-125-thread>: HTTP status code is not handled or not allowed
2026-01-10 20:50:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1005-standard-class-2-two-tone-mesh-zipper-safety-vest-lime-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:50:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1803-class-2-waist-adjustable-breakaway-vest-with-2-pockets-lime-mxl>: HTTP status code is not handled or not allowed
2026-01-10 20:50:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibration-mount-2-tapped-holes-157-inch-dia-30mm-h-m8-x-125-thread>: HTTP status code is not handled or not allowed
2026-01-10 20:50:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2005-standard-class-3-two-tone-mesh-zipper-safety-vest-lime-large>: HTTP status code is not handled or not allowed
2026-01-10 20:50:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-prestige-1500-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:50:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vibration-shock-absorption-mount-threaded-stud-79-inch-dia-20mm-h-m6-x-10-thread>: HTTP status code is not handled or not allowed
2026-01-10 20:50:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-nga51201d1hsosa-emergency-light-replacement-battery-1-3ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:50:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-24-w-6-step-steel-roll-ladder-14-d-top-stp-hndrl-orange-fsh626go>: HTTP status code is not handled or not allowed
2026-01-10 20:50:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/69000-series-hutch-with-doors-66-inchw-x-15-inchd-x-36-inchh-cherry>: HTTP status code is not handled or not allowed
2026-01-10 20:50:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/perf-24-w-5-step-steel-roll-ladder-21-d-top-hndrl-orange-fsh52621po>: HTTP status code is not handled or not allowed
2026-01-10 20:50:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sheet-metal-screw-square-pan-head-carbon-steel-6-x-12-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-24-w-12-step-stl-roll-lad-14-d-top-stp-hndrl-lck-orng-fs123214go>: HTTP status code is not handled or not allowed
2026-01-10 20:50:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-24-w-7-step-steel-roll-ladder-14-d-top-stp-hndrl-orange-fsh726go>: HTTP status code is not handled or not allowed
2026-01-10 20:50:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/grip-24-w-10-step-stl-roll-lad-21-d-top-stp-hndrl-lck-orng-fs103221go>: HTTP status code is not handled or not allowed
2026-01-10 20:50:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-drawer-heavy-duty-vertical-file-cabinet-15-inchw-x-25-inchd-x-28-3-8-inchh-black>: HTTP status code is not handled or not allowed
2026-01-10 20:50:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kawasaki-klf300-c-bayou-300-4x4-canada-300cc-atv-battery-1992-2005-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:50:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wallpro-450-black-wall-mount-retracting-barrier-25-yellow-belt>: HTTP status code is not handled or not allowed
2026-01-10 20:50:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reducing-bushing-zinc-alloy-1-12-x-12-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:50:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wallpro-450-yellow-wall-mount-retracting-barrier-25-yellowblack-authorized-access-only-belt>: HTTP status code is not handled or not allowed
2026-01-10 20:50:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sheet-metal-screw-combo-pan-head-carbon-steel-14-x-2-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/22oz-large-microfiber-string-mop-blue-2504-mfwp-22b>: HTTP status code is not handled or not allowed
2026-01-10 20:51:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-l-o-x-pneumatic-lockout-valve-y1523c6002-1-npt>: HTTP status code is not handled or not allowed
2026-01-10 20:51:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manual-l-o-x-pneumatic-lockout-valve-y1523c7012-114-npt>: HTTP status code is not handled or not allowed
2026-01-10 20:51:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pneumatic-mushroom-green-push-button-valve-d1223b1mpg-18-bspp>: HTTP status code is not handled or not allowed
2026-01-10 20:51:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48h-x-96w-slatwall-panelblack-laminate-without-inserts-968339B>: HTTP status code is not handled or not allowed
2026-01-10 20:51:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5bf09a-aluminum-solid-disk-handwheel-wo-handle-787-dia-x-625-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:51:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/concrete-screw-anchor-slotted-hex-washer-head-14-x-2-34-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/96w-40h-mobile-reversible-magnetic-whiteboard>: HTTP status code is not handled or not allowed
2026-01-10 20:51:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-cap-screw-grade-5-carbon-steel-516-18-x-1-14-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/un-rated-lid-with-lever-lock-for-5-gallon-open-head-steel-pails-987441>: HTTP status code is not handled or not allowed
2026-01-10 20:51:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sheet-metal-screw-square-pan-head-stainless-steel-8-x-1-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peg-perego-racing-truck-hp0214-ride-on-toys-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:51:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peg-perego-magnum-pick-up-d120-ride-on-toys-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:51:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/concrete-screw-anchor-slotted-hex-washer-head-316-x-1-14-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modern-equipment-meco-29vr-2-poly-overpack-drum-truck-rubber-casters-1000-lb>: HTTP status code is not handled or not allowed
2026-01-10 20:51:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tennis-tutor-r-prolite-tennis-ball-machine-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:51:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22012 pages (at 100 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:51:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrf17551h56c-cast-iron-right-angle-worm-gear-reducer-51-ratio-56c-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:51:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peg-perego-princess-raider-cycle-ride-on-toys-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:51:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/removable-tabs-2-x-11-16-assorted-colors-48-tabs-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:51:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-head-wood-screw-phillips-brass-10-x-34-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrs237201l-cast-iron-right-angle-worm-gear-reducer-201-ratio>: HTTP status code is not handled or not allowed
2026-01-10 20:51:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-hole-pipe-strap-carbon-steel-22-gauge-34-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrs20651l-cast-iron-right-angle-worm-gear-reducer-51-ratio>: HTTP status code is not handled or not allowed
2026-01-10 20:51:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrs237601l-cast-iron-right-angle-worm-gear-reducer-601-ratio>: HTTP status code is not handled or not allowed
2026-01-10 20:51:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/saunders-recycled-aluminum-forms-holder-side-opening-8-1-2-x-12-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:51:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-hole-punch-10-sheet-capacity-black-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:51:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tennis-tutor-r-prolite-plus-tennis-ball-machine-replacement-battery-9ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:51:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honda-gl1800-valkyrie-1800cc-motorcycle-replacement-battery-2014-2015-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:51:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hdrf133401l56c-cast-iron-right-angle-worm-gear-reducer-401-ratio-56c-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:51:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bourget-bike-works-citizen-soldier-iii-1900cc-motorcycle-battery-2010-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-head-wood-screw-phillips-carbon-steel-12-x-2-12-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-washer-silicon-bronze-0-316-id-0-12-od-8-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hello-my-name-is-name-badge-3-1-2-x-2-1-4-red-border-100-box>: HTTP status code is not handled or not allowed
2026-01-10 20:51:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/triumph-rocket-iii-classic-tourer-2300cc-motorcycle-battery-2007-2011-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-three-hole-punch-150-sheet-capacity-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:51:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mz-zschopau-saxon-tour-301cc-motorcycle-replacement-battery-1966-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:51:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/staples-30-sheet-capacity-1-4-leg-length-5000-box>: HTTP status code is not handled or not allowed
2026-01-10 20:51:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/american-ironhorse-ranger-t-1820cc-motorcycle-replacement-battery-2003-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:51:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ducati-hyperstrada-939-939cc-motorcycle-replacement-battery-2016-2018-12v-e>: HTTP status code is not handled or not allowed
2026-01-10 20:51:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-lag-screw-carbon-steel-38-x-3-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lock-washer-silicon-bronze-14-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rapid-heavy-duty-cartridge-stapler-80-sheet-210-staple-capacity-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:51:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-hand-held-stapler-20-sheet-105-staple-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 20:51:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/70-reduced-effort-stapler-70-sheet-capacity-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:51:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simson-sr-electric-start-50cc-motorcycle-replacement-battery-1993-1995-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:51:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/automatic-label-rewinder-for-up-to-8-1-2-w-x-12-diameter-3-core-rolls>: HTTP status code is not handled or not allowed
2026-01-10 20:51:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honda-gl1200sei-gold-wing-aspencade-1200cc-motorcycle-replacement-battery-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 20:51:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honda-cbx1000-super-sport-optional-1000cc-motorcycle-replacement-battery-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 20:51:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-softail-heritage-flst-1340cc-motorcycle-battery-1986-1990-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/universal-offset-strut-strap-carbon-steel-2-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-starter-csb73-1548-6x-48-inch-w-x-15-inch-d-x-73-inch-h-6-shelves-18-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:51:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honda-gl1800p-gold-wing-premium-audio-1800cc-motorcycle-battery-2006-2008-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-cvo-fxd-fat-bob-dyna-1803cc-motorcycle-battery-2007-2015-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honda-gl1500se-gold-wing-special-edition-1500cc-motorcycle-battery-1990-2000-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-street-bob-fxdbi-1450cc-motorcycle-replacement-battery-2006-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-starter-csb85-2436-5x-36-inch-w-x-24-inch-d-x-85-inch-h-5-shelves-18-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:51:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-xvs13ay-v-star-1300-1300cc-motorcycle-replacement-battery-2009-2015-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:51:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hex-head-lag-screw-carbon-steel-516-x-5-12-size-pack-of-100>: HTTP status code is not handled or not allowed
2026-01-10 20:51:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gvp3-vacuum-pump-14-oz-oil-capacity-3-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:51:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-drilling-screw-kit-hex-head-carbon-steel-8-10-size-assorted>: HTTP status code is not handled or not allowed
2026-01-10 20:51:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-mobile-shelf-truck-mst2448ts-steel-48-x-24-275-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:51:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/closed-add-on-cab73-1848-5-48-inch-w-x-18-inch-d-x-73-inch-h-5-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:51:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-174-plastic-standard-double-toilet-tissue-dispenser-two-5-1-4-rolls-smoke-gray-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:51:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eco-funnel-ef-3004c-8-with-38-430-cap-adapter-red-lid>: HTTP status code is not handled or not allowed
2026-01-10 20:51:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honda-gl1800hpn-gold-wing-audio-comfort-navi-1800cc-motorcycle-battery-2006-2010-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eco-funnel-ef-4-38-006n-4-with-polypropylene-quick-disconnect-adapter-red-lid>: HTTP status code is not handled or not allowed
2026-01-10 20:51:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aprilia-rsv4-factory-aprc-abs-1000cc-motorcycle-replacement-battery-2013-2015-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wal-5-16-4-flute-extractor>: HTTP status code is not handled or not allowed
2026-01-10 20:51:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/side-drain-port-for-6800-in-wall-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:51:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/protecta-3-way-retrieval-self-retracting-lifeline-w-bracket-galv-cable--steel-snap-hook-50l>: HTTP status code is not handled or not allowed
2026-01-10 20:51:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-54-inch-straight-tap-wrench>: HTTP status code is not handled or not allowed
2026-01-10 20:51:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-1-4-inch-capacity-mini-tap-wrench>: HTTP status code is not handled or not allowed
2026-01-10 20:51:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-nano-lok-edge-twin-leg-personal-self-retracting-lifeline-aluminum-rebar-lock-hook-8l>: HTTP status code is not handled or not allowed
2026-01-10 20:51:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kawasaki-jet-ski-jh750-xir-750cc-personal-watercraft-battery-1992-1999-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-ucpk206-19-pillow-block-bearing-low-base-set-screw-bore-30-1625-mm>: HTTP status code is not handled or not allowed
2026-01-10 20:51:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-22214exw33c3-70mm-bore-125mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:51:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/kawasaki-jet-ski-jt1500-stx-15f-1500cc-personal-watercraft-battery-2004-2016-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:51:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-23026ew33kc3-130mm-bore-200mm-od-tapered-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:51:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-hcfu206-20-flange-mount-bearing-4-bolt-flange-eccentric-locking-collar-bore-31-75-mm>: HTTP status code is not handled or not allowed
2026-01-10 20:51:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-ucf208-40mm-flange-mount-bearing-4-bolt-flange-set-screw-locking-bore-40-mm>: HTTP status code is not handled or not allowed
2026-01-10 20:51:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zipr-mobility-3traveler-mobility-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:51:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/drive-medical-pilot-2410-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:51:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-23038ew33c3-190mm-bore-290mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:51:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-hcpk206-20-pillow-block-bearing-low-base-ecc-lock-collar-bore-31-75-mm>: HTTP status code is not handled or not allowed
2026-01-10 20:51:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tritan-ucf212-36-flange-mount-bearing-4-bolt-flange-set-screw-locking-bore-57-15-mm>: HTTP status code is not handled or not allowed
2026-01-10 20:51:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cease-fire-round-waste-receptacle-steel-55-gallon-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 20:51:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-partition-wall-add-on-unit-7-1017hbc-baskets-18w-x-26d-x-70h-whitechrome>: HTTP status code is not handled or not allowed
2026-01-10 20:51:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-23230ew33c3-150mm-bore-270mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:51:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-partition-wall-add-on-unit-4-1035hbc--3-1635hbc-baskets-36w-x-26d-x-70h-white>: HTTP status code is not handled or not allowed
2026-01-10 20:51:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-hanging-label-tag-fits-1-38-x-3-adhesive-label-purple-pack-of-25>: HTTP status code is not handled or not allowed
2026-01-10 20:51:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-22338ew33c3-190mm-bore-400mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:51:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-row-spherical-roller-bearing-22248ew33kc3-240mm-bore-440mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:51:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5156-premium-low-profile-hydration-pack-black-2-ltr>: HTTP status code is not handled or not allowed
2026-01-10 20:51:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dagr-safety-glasses-silver-mirror-lens-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:51:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/odin-safety-glasses-blue-mirror-lens-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:51:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flammable-cabinet-self-close-double-door-22-gallon-capacity-35w-x-22d-x-35h>: HTTP status code is not handled or not allowed
2026-01-10 20:51:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6705ct-evaporative-cooling-triangle-hat-with-cooling-towel-flames>: HTTP status code is not handled or not allowed
2026-01-10 20:51:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3703-elastic-loop-tool-tails153-extended-15-lbs-lime-xtended-18>: HTTP status code is not handled or not allowed
2026-01-10 20:52:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/piaggio-vespa-et2-50cc-scooter-and-moped-replacement-battery-2001-2005-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flammable-cabinet-manual-close-double-door-60-gal-cap-34w-x-34d-x-65h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:52:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-row-cylindrical-roller-bearing-n217myc3-85mm-bore-150mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:52:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-partition-store-double-bay-cart-w-wire-baskets--shelves-44l-x-29-12w-x-74-12h-white>: HTTP status code is not handled or not allowed
2026-01-10 20:52:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bruno-cub-front-wheel-drive-mobility-scooter-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:52:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ada-braille-sign-all-gender-with-2-symbols--wheelchair-access-6w-x-9h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:52:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-row-cylindrical-roller-bearing-nu311eg-55mm-bore-120mm-od-high-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:52:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/thor-pz-safety-glasses-polarized-g15-lens-black-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:52:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8089-noncertified-tshirt-orange-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:52:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-row-cylindrical-roller-bearing-nj314mc3-70mm-bore-150mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:52:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quantum-partition-store-basket-cart-with-add-on-unit--wire-baskets-19-12l-x-24w-x-75h-chrome>: HTTP status code is not handled or not allowed
2026-01-10 20:52:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/golden-technologies-gse-600-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:52:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-row-cylindrical-roller-bearing-n322myc3-110mm-bore-240mm-od>: HTTP status code is not handled or not allowed
2026-01-10 20:52:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pacesaver-plus-iii-plus3-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:52:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-solid-shelf-18-x-48-186CP201>: HTTP status code is not handled or not allowed
2026-01-10 20:52:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/klip-it-open-add-on-oak73-1248-8-48-inch-w-x-12-inch-d-x-73-inch-h-8-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:52:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22110 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:52:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-in-lead-free-brass-tee-fnpt-125-psi-import>: HTTP status code is not handled or not allowed
2026-01-10 20:52:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/klip-it-closed-add-on-cak73-2442-7-42-inch-w-x-24-inch-d-x-73-inch-h-7-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:52:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelite-plastic-mat-18-x-15-end-panel-PME1815>: HTTP status code is not handled or not allowed
2026-01-10 20:52:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexelite-plastic-mat-24-x-15-end-panel-PME2415>: HTTP status code is not handled or not allowed
2026-01-10 20:52:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zap-new-century-electric-bicycle-electric-scooter-replacement-battery-12ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:52:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-esd-wire-shelving-unit-starter-72w-x-12d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bravo-mini-b2-electricscooter-electric-scooter-replacement-battery-5ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:52:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-in-304-stainless-steel-cap-fnpt-125-psi-import>: HTTP status code is not handled or not allowed
2026-01-10 20:52:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-2-in-x-1-1-8-in-lead-free-seamless-red-brass-pipe-nipple-140-psi-sch-40-domestic>: HTTP status code is not handled or not allowed
2026-01-10 20:52:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-bolt-open-add-on-oat87-2448-7-48-inch-w-x-24-inch-d-x-87-inch-h-7-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:52:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-bolt-open-add-on-oat75-1842-6-42-inch-w-x-18-inch-d-x-75-inch-h-6-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:52:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-esd-wire-shelving-unit-starter-48w-x-14d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mototec-solar-electric-go-kart-electric-scooter-replacement-battery-14ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:52:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-stainless-steel-wire-shelving-unit-starter-42w-x-14d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-stainless-steel-wire-shelving-unit-starter-54w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-esd-wire-shelving-unit-starter-54w-x-21d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-bolt-open-add-on-oat99-1836-5-36-inch-w-x-18-inch-d-x-99-inch-h-5-shelves-20-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:52:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-stainless-steel-wire-shelving-unit-starter-60w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-esd-wire-shelving-unit-starter-42w-x-24d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-esd-wire-shelving-unit-starter-60w-x-24d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-gtx-600-ho-sdi-593cc-snowmobile-replacement-battery-2005-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-wire-shelving-unit-add-on-48w-x-36d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-1-4-in-x-2-in-lead-free-seamless-red-brass-pipe-nipple-140-psi-sch-40-domestic>: HTTP status code is not handled or not allowed
2026-01-10 20:52:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sl-03390-su-q1500t3-cl-240v-1500w-double-ended-t3-halogen-bulb-rsc-base-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:52:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-bolt-open-add-on-oat75-1836-7x-36-inch-w-x-18-inch-d-x-75-inch-h-7-shelves-18-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:52:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-bolt-open-add-on-oat87-1842-5x-42-inch-w-x-18-inch-d-x-87-inch-h-5-shelves-18-ga-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:52:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5205zz-double-row-angular-contact-ball-bearing-double-shielded-od-52mm-bore-25mm-metric>: HTTP status code is not handled or not allowed
2026-01-10 20:52:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-chrome-wire-shelving-unit-starter-36w-x-14d-x-63h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-formula-stx-581cc-snowmobile-replacement-battery-1994-1996-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 20:52:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hotpod-8-in-silent-boot-sb8>: HTTP status code is not handled or not allowed
2026-01-10 20:52:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss68052rs-deep-groove-ball-bearing-stainless-steel-double-sealed-od-37mm-bore-25mmmetric>: HTTP status code is not handled or not allowed
2026-01-10 20:52:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/durable-tabs-2-solid-primary-colors-24-tabs-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-adhesive-index-tabs-with-printable-inserts-2-width-clear-25-tabs-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-mx-z-trail-500ss-553cc-snowmobile-replacement-battery-2007-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-rs-vector-ltx-973cc-snowmobile-replacement-battery-2008-2009-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-mx-z-1000-sdi-renegade-rt-998cc-snowmobile-battery-2007-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:52:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wtta-30-15-gallon-expansion-tank-asme-1-in-fnpt>: HTTP status code is not handled or not allowed
2026-01-10 20:52:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-gsx-380f-377cc-snowmobile-replacement-battery-2005-2006-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hxt-60-6-gallon-expansion-tank-hydronic-1-2-in-mnpt>: HTTP status code is not handled or not allowed
2026-01-10 20:52:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yamaha-fx-nytro-rtx-1049cc-snowmobile-replacement-battery-2008-2009-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-expedition-tuv-600-h-o-sdi-594cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/printable-self-adhesive-tabs-1-1-4-width-assorted-96-tabs-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-corrugated-boxes-12-x-6-x-3-200lb-test-ect-32-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/money-rent-receipt-book-2-part-carbonless-5-1-4-x-11-200-sets-pad>: HTTP status code is not handled or not allowed
2026-01-10 20:52:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pre-inked-message-date-stamp-received-1-5-16-x-2-1-8-blue-red>: HTTP status code is not handled or not allowed
2026-01-10 20:52:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-stainless-steel-wire-shelving-unit-add-on-24w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-stainless-steel-wire-shelving-unit-add-on-42w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/money-receipt-book-3-part-carbonless-2-3-4-x-7-100-sets-book>: HTTP status code is not handled or not allowed
2026-01-10 20:52:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-freeride-146-154-800r-800cc-snowmobile-battery-2014-2016-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:52:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-renegade-backcountry-x-600-ho-594cc-snowmobile-battery-2014-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:52:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-chrome-wire-shelving-unit-starter-36w-x-36d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/side-apply-correction-tape-tear-resistant-1-5-in-x-394-in-white-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/corrugated-mailers-4-x-4-x-4-200lb-test-ect-32-kraft-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-literature-mailers-13-x-13-x-3-200lb-test-ect-32-white-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-16-x-20-8-mil-clear-250-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-poly-bags-16-x-20-8-mil-clear-200-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-poppet-type-regulator-rv20l-3-8-up-to-65000-btu>: HTTP status code is not handled or not allowed
2026-01-10 20:52:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reclosable-poly-bags-3-x-5-8-mil-clear-1000-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-poly-green-wire-shelving-unit-add-on-60w-x-12d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/10-22-red-spring-red-r13110-for-rv131-210j-regulators>: HTTP status code is not handled or not allowed
2026-01-10 20:52:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-green-wire-shelving-unit-add-on-60w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/flat-corrugated-boxes-10-x-7-x-3-200lb-test-ect-32-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:52:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-straight-flow-thru-regulator-rv91-2-1-2-up-to-7500000-btu>: HTTP status code is not handled or not allowed
2026-01-10 20:52:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-green-wire-shelving-unit-add-on-72w-x-12d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:52:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-summit-500-f-496cc-snowmobile-replacement-battery-2001-2002-12v-i>: HTTP status code is not handled or not allowed
2026-01-10 20:52:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-mach-z-1000-sdi-995cc-snowmobile-replacement-battery-2005-2007-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/honeywell-wiring-subbase-q7800a1005-panel-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:52:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-mx-z-renegade-x-800-ho-ptek-800cc-snowmobile-battery-2004-2013-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:52:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/line-voltage-thermostat-industrial-series-spst-cool-only-6-cord-plug-kto121>: HTTP status code is not handled or not allowed
2026-01-10 20:52:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-skandic-lt-440f-437cc-snowmobile-replacement-battery-2003-2006-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/modern-equipment-meco-bct144-10-bar-cradle-truck-144-l-10-000-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:52:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-legend-380f-368cc-snowmobile-replacement-battery-2002-2003-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:52:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-renegade-backcountry-800r-800cc-snowmobile-battery-2014-2016-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:52:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-8664-containment-berm-rapid-rise-15-x-50-22-oz-pvc>: HTTP status code is not handled or not allowed
2026-01-10 20:52:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-1ic-inner-core-w-bulb-auger-25-feet-l-x-5-16-inch-w-cable>: HTTP status code is not handled or not allowed
2026-01-10 20:52:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-mx-z-renegade-x-800r-800cc-snowmobile-replacement-battery-2004-2013-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:52:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/faceshield-headgear-for-use-with-protective-caps-plastic-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:52:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-8474-containment-berm-foam-wall-10-x-50-22-oz-pvc>: HTTP status code is not handled or not allowed
2026-01-10 20:52:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/miller-aircore-stretchable-harness-with-back-d-ring-tongue-buckle-universal-green>: HTTP status code is not handled or not allowed
2026-01-10 20:52:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultra-8479-containment-berm-foam-wall-12-x-60-22-oz-pvc>: HTTP status code is not handled or not allowed
2026-01-10 20:52:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/miller-h500-construction-comfort-harness-w-front-side-d-rings-universal-green>: HTTP status code is not handled or not allowed
2026-01-10 20:52:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/42w-square-pedestal-table-with-graphite-nebula-top-round-silver-base-bistro-height>: HTTP status code is not handled or not allowed
2026-01-10 20:53:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/36w-square-pedestal-table-with-graphite-nebula-top-round-silver-base>: HTTP status code is not handled or not allowed
2026-01-10 20:53:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-mxz-tnt-1200-1170cc-snowmobile-replacement-battery-2014-2016-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:53:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nitri-knit153-chemical-resistant-gloves-nitrile-size-7-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:53:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hollow-steel-narrow-light-glass-door-cylindrical-hollow-hinge-wglass-18-ga-36w-x-84h>: HTTP status code is not handled or not allowed
2026-01-10 20:53:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plastic-locker-11-9z1212720-z-style-12-x-12-x-72-1-wide-cream>: HTTP status code is not handled or not allowed
2026-01-10 20:53:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plastic-locker-11-9z1218720-z-style-12-x-18-x-72-1-wide-cream>: HTTP status code is not handled or not allowed
2026-01-10 20:53:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plastic-locker-11-921215720-double-tier-12-x-15-x-36-1-wide-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:53:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/door-louver-kit-galvannealed-steel-10w-x-10h>: HTTP status code is not handled or not allowed
2026-01-10 20:53:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plastic-locker-11-931215720-triple-tier-12-x-15-x-24-1-wide-cream>: HTTP status code is not handled or not allowed
2026-01-10 20:53:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/-200-trade-turbo-rim-diamond-blade-7-dia-x-316t-x-78-center-hole-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:53:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v5719-corner-box-ivory-2-12l>: HTTP status code is not handled or not allowed
2026-01-10 20:53:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/-200-trade-continuous-rim-diamond-blade-10-dia-x-316t-x-1-center-hole-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:53:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/intelligent-rewinderunwinder-for-up-to-6-12w-media-capacity--12-roll-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:53:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-freeride-146-154-800r-800cc-snowmobile-replacement-battery-2014-2016-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:53:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electrically-conductive-floor-mat-916-thick-2-x-3-black>: HTTP status code is not handled or not allowed
2026-01-10 20:53:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5741wh-device-box-white-4-58l>: HTTP status code is not handled or not allowed
2026-01-10 20:53:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22208 pages (at 98 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:53:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plus-phenolic-locker-11-811212721-single-tier-12-x-12-x-72-dove-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:53:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-skandic-550f-tundra-550cc-snowmobile-replacement-battery-2010-2011-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:53:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traditional-plus-phenolic-locker-11-811215721-single-tier-12-x-15-x-72-silver-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:53:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vapor-tension-panel-thermometer-6812-01-3>: HTTP status code is not handled or not allowed
2026-01-10 20:53:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cooper-mini-wall-thermometer-trh122m-0-8-digital-temperature-and-humidity-dual-display>: HTTP status code is not handled or not allowed
2026-01-10 20:53:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-522-07-short-block-for-engine-models-ezt740-750>: HTTP status code is not handled or not allowed
2026-01-10 20:53:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/timer-ft-24-0-3-large-single-station>: HTTP status code is not handled or not allowed
2026-01-10 20:53:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-grand-touring-se-800-sdi-800cc-snowmobile-replacement-battery-2003-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:53:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/recycled-rubber-cone-weight-7-lb-black>: HTTP status code is not handled or not allowed
2026-01-10 20:53:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-dove-7-inch-x-3-8-inch-140670072>: HTTP status code is not handled or not allowed
2026-01-10 20:53:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/angle-broom-high-performance-bristles-9-w-yellow-gjo58562>: HTTP status code is not handled or not allowed
2026-01-10 20:53:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vented-plastic-shelving-30x21x54-nexelon-finish-331448N>: HTTP status code is not handled or not allowed
2026-01-10 20:53:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-renegade-800-backcountry-x-800cc-snowmobile-replacement-battery-2010-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:53:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/time-clock--document-stamp>: HTTP status code is not handled or not allowed
2026-01-10 20:53:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-mx-z-600-ho-trail-and-adrenaline-and-x-593cc-snowmobile-battery-2004-2005-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:53:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-magnetic-v-block-with-onoff-switch-2-18-4-3-34>: HTTP status code is not handled or not allowed
2026-01-10 20:53:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/big-joe-fully-powered-straddle-stacker-2200-lb-cap-62-lift-forks-over-legs-987522>: HTTP status code is not handled or not allowed
2026-01-10 20:53:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3337-00003-solar-powered-led-strobe-lights-white-bulb>: HTTP status code is not handled or not allowed
2026-01-10 20:53:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sealer-sales-kf-150cst-portable-direct-heat-sealer-with-15mm-seal-w-pedal-set>: HTTP status code is not handled or not allowed
2026-01-10 20:53:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sealer-sales-kf-series-20-hand-sealer-w-2-6mm-seal>: HTTP status code is not handled or not allowed
2026-01-10 20:53:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4910-double-sided-vhb-acrylic-foam-tape-1-2-x-5-yds-40-mil-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:53:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-549cp-brass-commercial-14-turn-sillcock-valve-with-vacuum-breaker-12-fnpt>: HTTP status code is not handled or not allowed
2026-01-10 20:53:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-337ab-butterfly-valve-with-buna-seals--10-position-handle-6-wafer>: HTTP status code is not handled or not allowed
2026-01-10 20:53:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fao-forceps-steel-3-5>: HTTP status code is not handled or not allowed
2026-01-10 20:53:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/explosion-proof-motor-hg456-5kh35lnb164x-1-6hp-115v-1800rpm-1ph-epnv>: HTTP status code is not handled or not allowed
2026-01-10 20:53:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-712-2-piece-full-port-316-ball-valve-stainless-steel-2-12-threaded>: HTTP status code is not handled or not allowed
2026-01-10 20:53:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/storage-argos-half-shelf-ws-6421-ws25-stealth>: HTTP status code is not handled or not allowed
2026-01-10 20:53:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/centrifugal-pump-motor-j1025-1-3hp-115-230v-3600rpm-split-ph-56c-fr-dp>: HTTP status code is not handled or not allowed
2026-01-10 20:53:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-365ss-butterfly-valve-with-epdm-seals--10-position-handle-6-lug>: HTTP status code is not handled or not allowed
2026-01-10 20:53:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/carbonator-pump-motor-hg679-1-4hp-115v-1800rpm-split-ph-48y-fr-dp>: HTTP status code is not handled or not allowed
2026-01-10 20:53:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/aluminum-mailbox-2210-23-1-2w-x-15-1-2d-x-30h-10-doors-standard-system>: HTTP status code is not handled or not allowed
2026-01-10 20:53:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-335ab-g-butterfly-valve-with-epdm-seals--gear-operator-10-wafer>: HTTP status code is not handled or not allowed
2026-01-10 20:53:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f781-1-2hp-208-230v-850rpm-1ph-tenv-56y-fr>: HTTP status code is not handled or not allowed
2026-01-10 20:53:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-367ab-g-butterfly-valve-with-buna-seals--gear-operator-10-lug>: HTTP status code is not handled or not allowed
2026-01-10 20:53:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infrasonics-adult-star-2000-medical-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:53:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lincoln-electric-company-aead-200le-hf864864-industrial-battery-35ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:53:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-335di-butterfly-valve-with-epdm-seals--10-position-handle-12-wafer>: HTTP status code is not handled or not allowed
2026-01-10 20:53:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/screenflex-portable-room-divider-fire-resistant-74hx205l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:53:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/explosion-proof-motor-u024-184ttgs4030-5hp-575v-1800rpm-3ph-epfc>: HTTP status code is not handled or not allowed
2026-01-10 20:53:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ferno-ille-5000-6000-9650-lift-medical-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:53:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd-square-bellman-cart-2799bk-010-blk-stainless-black-carpet-black-bumper-8-pneumatic>: HTTP status code is not handled or not allowed
2026-01-10 20:53:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/114604c-round-dome-utility-electric-marker-white-pole-78h-54-above-ground-red>: HTTP status code is not handled or not allowed
2026-01-10 20:53:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/113789a-round-dome-utility-sewer-marker-white-pole-78h-54-above-ground-green>: HTTP status code is not handled or not allowed
2026-01-10 20:53:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/picker-inernational-l-model-502-medical-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:53:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-303-os--y-gate-valve-cast-iron-3-flanged>: HTTP status code is not handled or not allowed
2026-01-10 20:53:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c147-5kc35jn10-1-4hp-1725rpm-115-208-230v-1ph-48-fr-dp>: HTTP status code is not handled or not allowed
2026-01-10 20:53:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/xantrex-technology-xpower-powerpack-1500-jump-starter-battery-22ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:53:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ppi-pp-146014-sharps-container-14-qt-red-big-mouth-case-10>: HTTP status code is not handled or not allowed
2026-01-10 20:53:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sp-9413-1-hp-ultra-quiet-oil-free-air-compressor-motor>: HTTP status code is not handled or not allowed
2026-01-10 20:53:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hyperpure-pe-rt-tubing-1id-x-1-18od-x-100-coil-white>: HTTP status code is not handled or not allowed
2026-01-10 20:53:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sebra-1071-mobile-tube-sealer-medical-replacement-battery-26ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:53:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nps-chemical-resistant-adjustable-height-science-table-plain-front-24-x-48-x-29-41-w-oak-legs>: HTTP status code is not handled or not allowed
2026-01-10 20:53:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ss-component-strip-heater-240v-500w-11-34l>: HTTP status code is not handled or not allowed
2026-01-10 20:53:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/newmox-fnc-12150-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:53:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-301-non-rising-stem-gate-valve-cast-iron-2-flanged>: HTTP status code is not handled or not allowed
2026-01-10 20:53:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k1322-5k42fn4035-1-3hp-1800rpm-575v-3ph-56c-fr-tefc>: HTTP status code is not handled or not allowed
2026-01-10 20:53:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/902-355-heat-shrink-tubing-4l-black-160-pcs>: HTTP status code is not handled or not allowed
2026-01-10 20:53:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/900-098-rd-cable-tie-hook-tape-8l-x-12w-red-25pk>: HTTP status code is not handled or not allowed
2026-01-10 20:53:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sunnyway-swg12700-sealed-lead-acid-replacement-battery-75ah-12v-it>: HTTP status code is not handled or not allowed
2026-01-10 20:53:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-h290-5kh36mn137-1-2hp-1725rpm-115v-1-ph-56cz-fr>: HTTP status code is not handled or not allowed
2026-01-10 20:53:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-blower-motor-g1115-5kc35jn7x-1-4hp-1725rpm-115-230v-1ph-48-fr-dp>: HTTP status code is not handled or not allowed
2026-01-10 20:53:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vision-cp12180-x-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:53:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/class-3-three-way-bottom-bomber-jacket-with-removable-liner-yellowblack-l>: HTTP status code is not handled or not allowed
2026-01-10 20:53:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/condenser-fan-motor-x501-3-4hp-1200-rpm-200-230-460-v-3-ph-56y-fr-opao>: HTTP status code is not handled or not allowed
2026-01-10 20:53:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-k277-5k46kn4085-3-4hp-1725-1425rpm-208-230-460v-3-ph-56-fr>: HTTP status code is not handled or not allowed
2026-01-10 20:53:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/super-kemite-butyl-degreaser-cherry-scent-1-gallon-capacity-bottle-4carton>: HTTP status code is not handled or not allowed
2026-01-10 20:53:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oven-fryer-grill-cleaner-characteristic-scent-1-gallon-capacity-bottle-4carton>: HTTP status code is not handled or not allowed
2026-01-10 20:53:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/180-degree-motion-activated-led-area-light-with-dual-solar-panel-10w-1200-lm-black>: HTTP status code is not handled or not allowed
2026-01-10 20:53:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cortina-plastx-type-i-fold-flat-barricade-hip-grade-sheeting-24l-x-8w-panel-orangewhite>: HTTP status code is not handled or not allowed
2026-01-10 20:53:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cortina-plastx-type-i-fold-flat-barricade-with-direction-indicator-24l-x-12w-panel-orangewhite>: HTTP status code is not handled or not allowed
2026-01-10 20:53:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/yuasa-np7-12-250fr-sealed-lead-acid-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:53:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/oil-burner-motor-o601-48s17t290-1-6hp-1725rpm-115v-1ph-48n-tenv>: HTTP status code is not handled or not allowed
2026-01-10 20:53:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/16-gal-sat-blk-waste-recept-sat-alum-lid-w-funnel-top-f1533-bk-sa>: HTTP status code is not handled or not allowed
2026-01-10 20:53:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-blower-motor-x010-48a11o2046-3-4hp-1075rpm-208-230v-1ph-48y-fr-opao>: HTTP status code is not handled or not allowed
2026-01-10 20:53:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sigmastek-sp12-35-sealed-lead-acid-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:53:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fan-blower-motor-c1156-5kc46ln0149x-3-4hp-1725rpm-115-208-230v-1ph-56-fr-dp>: HTTP status code is not handled or not allowed
2026-01-10 20:53:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/firstpower-fp640b-sealed-lead-acid-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:53:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/caterpillar-cs431-cs443-industrial-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:53:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nps-adj-height-science-lab-table-chemical-resistant-top-72l-x-30w-x-22-14-37-14h-blackgray>: HTTP status code is not handled or not allowed
2026-01-10 20:53:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/upsonic-ip-6000it-sealed-lead-acid-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:53:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/werker-wka12-18f2-sealed-lead-acid-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:53:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/coopower-cp12-1-2-sealed-lead-acid-replacement-battery-1-3ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:54:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60010021214-stikitgold-disc-roll-6dia-p180-grit>: HTTP status code is not handled or not allowed
2026-01-10 20:54:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orange-traffic-cone-mount-retracting-belt-barrier-10-fluorescent-orange-belt>: HTTP status code is not handled or not allowed
2026-01-10 20:54:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m6bzr-multi-outlet-power-unit-120v-15a>: HTTP status code is not handled or not allowed
2026-01-10 20:54:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/v2015-tee-fitting-125v-15a-6l>: HTTP status code is not handled or not allowed
2026-01-10 20:54:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-coin-grip-anti-slip-rubber-mat-2mm-x-4-x-35-rolled-rubber-black>: HTTP status code is not handled or not allowed
2026-01-10 20:54:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nm2000bc-raceway-base-and-cover-120v-15a-5l>: HTTP status code is not handled or not allowed
2026-01-10 20:54:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-nexelon-blue-wire-shelving-unit-add-on-24w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-cal-coin-grip-anti-slip-rubber-mat-2mm-x-4-x-12-rolled-rubber-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:54:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fullriver-hghl1255w-sealed-lead-acid-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:54:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ul209bc-multi-outlet-power-unit-125v-15a-13l-8-outlets-6-cord>: HTTP status code is not handled or not allowed
2026-01-10 20:54:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ul218bc-multi-outlet-power-unit-125v-15a-15l-8-outlets-6-cord>: HTTP status code is not handled or not allowed
2026-01-10 20:54:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/firstpower-lfp1260d-sealed-lead-acid-replacement-battery-75ah-12v-it>: HTTP status code is not handled or not allowed
2026-01-10 20:54:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ulbh6-6-multi-outlet-power-unit-13-14l-6-outlets-6-cord>: HTTP status code is not handled or not allowed
2026-01-10 20:54:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wd-40-174-specialist-174-electrical-contact-cleaner-spray-11-oz-aerosol-can-300080>: HTTP status code is not handled or not allowed
2026-01-10 20:54:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sigmastek-sp12-18-t2-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:54:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/71430-0100-lab-blower-tefc-pp-frp-1725-rpm>: HTTP status code is not handled or not allowed
2026-01-10 20:54:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelon-blue-wire-shelving-unit-starter-54w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22307 pages (at 99 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:54:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ajc-interstate-dcm0075-12v-75ah-wheelchair-battery>: HTTP status code is not handled or not allowed
2026-01-10 20:54:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power-sonic-ps-12180f-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:54:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/enduring-6fm17-6-fm-17-sealed-lead-acid-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:54:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-black-epoxy-wire-shelving-unit-starter-42w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-black-epoxy-wire-shelving-unit-starter-60w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/palmgren-9680342-radial-arm-5-speed-floor-step-pulley-drill-press>: HTTP status code is not handled or not allowed
2026-01-10 20:54:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-gallon-spill-tray-46l-x-16w>: HTTP status code is not handled or not allowed
2026-01-10 20:54:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-nexelate-silver-epoxy-wire-shelving-unit-add-on-42w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5009-18mm-silver-snap-off-blade-pkg-qty-10>: HTTP status code is not handled or not allowed
2026-01-10 20:54:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1086530-1-multi-purpose-scraper>: HTTP status code is not handled or not allowed
2026-01-10 20:54:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/duracell-slaa12-0-8jst-sealed-lead-acid-replacement-battery-7ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:54:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-liner-1-16-clear-acrylic-48-x-18>: HTTP status code is not handled or not allowed
2026-01-10 20:54:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelate-silver-epoxy-wire-shelving-unit-add-on-36w-x-14d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/imc-heartway-escape-hp1-wheelchair-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:54:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/19-gallon-2-door-manual-fume-hood-acid-cabinet-30x21-5-8x35-3-4-lgt-neutral>: HTTP status code is not handled or not allowed
2026-01-10 20:54:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelate-silver-epoxy-wire-shelving-unit-add-on-72w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/40-gallon-2-door-self-close-paint-ink-cabinet-43w-x-18d-x-44h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:54:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laminating-pouches-5-mil-2-5-8-x-3-7-8-id-size-25-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:54:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/go-go-travel-mobility-elite-traveller-sc53hd-wheelchair-battery-22ah-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:54:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digital-security-power832-option-2-alarm-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:54:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-nexelate-silver-epoxy-wire-shelving-unit-starter-54w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-55-gal-drum-self-close-flammable-cabinet-incl-drum-support-34w-x-34d-x-65h-red>: HTTP status code is not handled or not allowed
2026-01-10 20:54:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-55-gal-drum-2-door-manual-acid-drum-cabinet-43w-x-34d-x-65h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:54:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ibc-indoor-pallet>: HTTP status code is not handled or not allowed
2026-01-10 20:54:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/51169-core-dx-hospital-medical-lab-cart-23-x-19-x-35-almond-beige>: HTTP status code is not handled or not allowed
2026-01-10 20:54:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-nexelate-silver-epoxy-wire-shelving-unit-add-on-54w-x-14d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/60-gallon-2-door-self-close-acid-cabinet-34w-x-34d-x-65h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:54:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-nexelate-silver-epoxy-wire-shelving-unit-starter-72w-x-21d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/21st-century-scientific-1fl-wheelchair-replacement-battery-100ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:54:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/quick-coupler-39040925-12-body-coupler-set-poppet-12fnpt>: HTTP status code is not handled or not allowed
2026-01-10 20:54:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hose-assembly-98398327-100r2at-cpld-3500-psi-12-mnpt-12-hose-id-x-84l>: HTTP status code is not handled or not allowed
2026-01-10 20:54:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-h-cylinder-vertical-medical-fire-lined-gas-cabinet-43w-x-34d-x-65h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-z-brite-wire-shelving-unit-add-on-36w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/merits-s541-deluxe-buggy-wheelchair-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:54:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-poly-z-brite-wire-shelving-unit-add-on-60w-x-18d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/five-wing-condenser-fan-blade-interchangeable-hub-aluminum-cw-22-inch-dia-33-pitch>: HTTP status code is not handled or not allowed
2026-01-10 20:54:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-poly-z-brite-wire-shelving-unit-add-on-36w-x-14d-x-86h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-z-brite-wire-shelving-unit-add-on-60w-x-14d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-z-brite-wire-shelving-unit-add-on-54w-x-21d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-inlet-blower-wheel-15-1-2-inch-dia-cw-or-ccw-9-1-2-inch-w-1-3-16-inch-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:54:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-2-shelf-poly-z-brite-wire-shelving-unit-add-on-72w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-inlet-blower-wheel-6-1-4-inch-dia-cw-2000-rpm-1-2-inch-bore-4-1-4-inch-w-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 20:54:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-173-rolling-case-16-1-2-x-8-x-14-1-4-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:54:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-galvanized-steel-solid-shelving-unit-add-on-36w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-m1000-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:54:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-z-brite-wire-shelving-unit-starter-60w-x-18d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-poly-z-brite-wire-shelving-unit-starter-60w-x-24d-x-34h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jacobsen-super-chief-lawn-and-garden-replacement-battery-8ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:54:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dfl-f-18x36-drainable-blade-fixed-louver-with-flange-18wx36h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-wing-belt-drive-bearing-brackets-for-12-inch-blower>: HTTP status code is not handled or not allowed
2026-01-10 20:54:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-wall-mounted-receiving-desk>: HTTP status code is not handled or not allowed
2026-01-10 20:54:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-inlet-blower-wheel-13-3-16-inch-dia-cw-or-ccw-12-5-8-inch-w-3-4-inch-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:54:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/small-fixed-hub-fan-blade-6-1-2-inch-dia-27-pitch-ccw-1-4-inch-bore-13-16-inch-blade-dep-4-blade>: HTTP status code is not handled or not allowed
2026-01-10 20:54:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-base-cabinet-bc-4401-2-hinged-doors-1-shelf-sink-bowl-36x21x36>: HTTP status code is not handled or not allowed
2026-01-10 20:54:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stainless-steel-base-cabinet-bc-1600-2-hinged-doors-1-shelf-1-drawer-30x21x36>: HTTP status code is not handled or not allowed
2026-01-10 20:54:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-poly-z-brite-wire-shelving-unit-add-on-72w-x-14d-x-74h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/single-inlet-blower-wheel-8-1-2-inch-dia-cw-1650-rpm-1-2-inch-bore-3-3-16-inch-w-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 20:54:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/two-wing-condenser-fan-blade-interchangeable-hub-aluminum-blade-22-inch-dia-27-pitch>: HTTP status code is not handled or not allowed
2026-01-10 20:54:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/concealite-f5-12-4-emergency-light-replacement-battery-7ah-12v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:54:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-12jm4cs-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:54:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-nexelite-3-shelf-vented-plastic-mat-shelving-unit-starter-60w-x-21d-x-54h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-ilsm27-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:54:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/emergi-lite-12csm54-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:54:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/power174-zoomie-20-rechargeable-flashlight-1200-lumens-black>: HTTP status code is not handled or not allowed
2026-01-10 20:54:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/orion-e-500-electric-comb-binding-machine>: HTTP status code is not handled or not allowed
2026-01-10 20:54:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glossy-pouches-letter-3-mil-50-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:54:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mt-1233d-multimeter-digital-3-1-2>: HTTP status code is not handled or not allowed
2026-01-10 20:54:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/industrial-workbench-vise-with-swivel-base-8-jaw-width-4-3164-throat-depth>: HTTP status code is not handled or not allowed
2026-01-10 20:54:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-wide-boltless-shelving-add-on-72-in-w-x-48-in-d-x-60-in-h>: HTTP status code is not handled or not allowed
2026-01-10 20:54:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-wide-manual-tapelabel-dispenser>: HTTP status code is not handled or not allowed
2026-01-10 20:54:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rotor-adapters-19200317-12pcs-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:54:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-wide-boltless-shelving-add-on-60-in-w-x-36-in-d-x-96-in-h-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:54:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ball-ring-hitch-lock-keyed-alike-brhl-ka>: HTTP status code is not handled or not allowed
2026-01-10 20:54:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-wide-boltless-shelving-add-on-96in-w-x-48in-d-x-96in-h-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:54:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-wide-boltless-shelving-add-on-96-in-w-x-48-in-d-x-96-in-h-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:54:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/self-adhesive-folder-labels-9-16-x-3-7-16-white-260-box>: HTTP status code is not handled or not allowed
2026-01-10 20:54:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-wide-boltless-shelving-add-on-72-in-w-x-24-in-d-x-96-in-h-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:54:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filter-lcd-privacy-15-bk>: HTTP status code is not handled or not allowed
2026-01-10 20:54:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filter-lcd-privacy-215-bk>: HTTP status code is not handled or not allowed
2026-01-10 20:55:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-flange-shelf-18-inch-l-x-36-inch-w-18-gauge-750-lb-capacity-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:55:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-flange-shelf-18-inch-l-x-48-inch-w-20-gauge-275-lb-capacity-dark-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:55:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-wide-boltless-shelving-add-on-72-in-w-x-15-in-d-x-96-in-h-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:55:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-shelf-extra-hd-boltless-shelving-add-on-36-in-w-x-24-in-d-x-84-in-h-laminate-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:55:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-wide-boltless-shelving-add-on-96-in-w-x-36-in-d-x-60-in-h-wood-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:55:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/862ck-12-floor-box-w896ck-12-carpet-brass-cover>: HTTP status code is not handled or not allowed
2026-01-10 20:55:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/radiant-barrier-sol4125rt-125l-x-4w-x-14h-reflectivereflective-with-tape>: HTTP status code is not handled or not allowed
2026-01-10 20:55:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fbs-bellman-cart-2512-ss-bk-bk-stainless-black-carpet-black-bumper-8-pneumatic>: HTTP status code is not handled or not allowed
2026-01-10 20:55:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cts-2300-undermount-stainless-steel-single-bowl-kitchen-sink>: HTTP status code is not handled or not allowed
2026-01-10 20:55:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-789552300-emergency-light-replacement-battery-12ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:55:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-step-commercial-rolling-step-ladder-19-1116l-x-22-716w-x-22-1316h-grayblue>: HTTP status code is not handled or not allowed
2026-01-10 20:55:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-counter-height-storage-cabinet-all-welded-36w-x-18d-x-36h-textured-blk>: HTTP status code is not handled or not allowed
2026-01-10 20:55:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/shelf-bumper-guard-type-g-164-1-116-1-14-black-60-6760-3>: HTTP status code is not handled or not allowed
2026-01-10 20:55:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sonnenschein-889556500-emergency-light-replacement-battery-18ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:55:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gcm12sd-12-inch-dual-bevel-glide-miter-saw>: HTTP status code is not handled or not allowed
2026-01-10 20:55:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ff63bbisstbada-ada-compliant-built-in-undercounter-all-refrigerator-black-23-58w>: HTTP status code is not handled or not allowed
2026-01-10 20:55:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/national-power-gs012p1-emergency-light-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:55:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22403 pages (at 96 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:55:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-wall-mounted-storage-cabinet-all-welded-30w-x-12d-x-26h-putty>: HTTP status code is not handled or not allowed
2026-01-10 20:55:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ekg-medical-cart-slate-blue-cool-grey>: HTTP status code is not handled or not allowed
2026-01-10 20:55:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/elite-all-welded-wardrobe-cabinet-solid-door-46w-x-24d-x-72h-putty>: HTTP status code is not handled or not allowed
2026-01-10 20:55:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ps-70-f-rye-privacy-screen>: HTTP status code is not handled or not allowed
2026-01-10 20:55:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awrd-partition-80x84-f-navy-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:55:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regenerative-blower-ab-91-1-phase-1-stage-033-hp>: HTTP status code is not handled or not allowed
2026-01-10 20:55:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/prospec-hd100-e12-full-zipper-replacement-cloth-vacuum-bag-gk-sanicloth>: HTTP status code is not handled or not allowed
2026-01-10 20:55:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/five-shelf-extra-hd-boltless-shelving-add-on-36in-w-x-12in-d-x-96in-h-laminate-deck-usa>: HTTP status code is not handled or not allowed
2026-01-10 20:55:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/three-shelf-boltless-shelving-add-on-solid-deck-3300-lb-cap-96in-w-x-48in-d-x-84in-h-usa>: HTTP status code is not handled or not allowed
2026-01-10 20:55:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awrd-partition-80x84-p-green>: HTTP status code is not handled or not allowed
2026-01-10 20:55:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awrd-partition-80x84-f-royal-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:55:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smoking-shelter-63wsvrca-4sided-l-r-open-fr-15l-x-76w-vented-standing-seam-roof-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:55:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smoking-shelter-42wsvrdkb-4sided-l-r-open-fr-10l-x-5w-vented-standing-seam-roof-dk-brz>: HTTP status code is not handled or not allowed
2026-01-10 20:55:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awrd-partition-88x84-p-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:55:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smoking-shelter-s66fca-4sided-wleft-open-front-15l-x-15w-flat-roof-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:55:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/versifold-8-x-66-blue-portable-partition>: HTTP status code is not handled or not allowed
2026-01-10 20:55:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/four-shelf-heavy-duty-boltless-shelving-add-on-48in-w-x-18in-d-x-60in-h-wire-deck>: HTTP status code is not handled or not allowed
2026-01-10 20:55:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peg-perego-traffic-police-ride-on-toys-replacement-battery-4-5ah-6v-f1>: HTTP status code is not handled or not allowed
2026-01-10 20:55:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-toner-cartridge-tg85p6478-for-hp-q5942a-black>: HTTP status code is not handled or not allowed
2026-01-10 20:55:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/98-black-original-ink-cartridge>: HTTP status code is not handled or not allowed
2026-01-10 20:55:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tote-alls-tote-container-24-18l-x-14-38w-x-12h-blue-270085BL>: HTTP status code is not handled or not allowed
2026-01-10 20:55:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/truck-cargo-net-grommet-fastening-syst-debris-liner-55-in-55-in-ttgsdl>: HTTP status code is not handled or not allowed
2026-01-10 20:55:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd36-2dr-two-36-skates-one-with-drift-resister>: HTTP status code is not handled or not allowed
2026-01-10 20:55:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/garelli-grinta-50cc-motorcycle-replacement-battery-1995-1996-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:55:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fireplace-gloves-fa310g>: HTTP status code is not handled or not allowed
2026-01-10 20:55:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f20-face-shield-window-polycarb-8l-x-15-12w-116-thick-clear-pk-of-12>: HTTP status code is not handled or not allowed
2026-01-10 20:55:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f30-face-shield-window-acetate-8l-x-15-12w-116-thick-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:55:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/f40-face-shield-window-propionate-9l-x-15-12w-116-thick-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:55:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laverda-ghost-650cc-motorcycle-replacement-battery-1962-2004-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:55:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-nano-lok-twin-leg-hot-work-self-retracting-lifeline-web--steel-comfort-grip-hook-6l>: HTTP status code is not handled or not allowed
2026-01-10 20:55:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/m10-a-metric-eyebolt-shoulder-pattern-m10-x-150-short-shank>: HTTP status code is not handled or not allowed
2026-01-10 20:55:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k2027-a-carbon-eyebolt-shoulder-pattern-5-8-11-1-1-4-shank>: HTTP status code is not handled or not allowed
2026-01-10 20:55:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/920-case-w-foam-16-11-16l-x-13-3-8w-x-6-13-16h-graphite>: HTTP status code is not handled or not allowed
2026-01-10 20:55:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/padded-divider-for-930-case>: HTTP status code is not handled or not allowed
2026-01-10 20:55:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/905-case-w-padded-divider-12-1-2l-x-10w-x-6h-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:55:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/925-case-w-padded-divider-18-11-16l-x-14-13-16w-x-7h-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:55:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motobecane-active-80cc-motorcycle-replacement-battery-1942-1984-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:55:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/foam-inserts-3-part-for-915-case>: HTTP status code is not handled or not allowed
2026-01-10 20:55:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/905-case-12-1-2l-x-10w-x-6h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:55:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/930-case-w-foam-19-13-16l-x-16w-x7-5-8h-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:55:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-access-control-cabinet-with-electronic-lock-3704cxc-blp4s-95-24w-x-60d-x-78h>: HTTP status code is not handled or not allowed
2026-01-10 20:55:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pam-puncture-resistant-anti-fatigue-insole-mens-1213>: HTTP status code is not handled or not allowed
2026-01-10 20:55:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eye-flush-solution-with-first-aid-kit-24-050>: HTTP status code is not handled or not allowed
2026-01-10 20:55:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heat-shield-blanket-96x72-9672-1>: HTTP status code is not handled or not allowed
2026-01-10 20:55:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dbi-sala-nano-lok-twin-leg-arc-flash-self-retracting-lifeline-quick-connect-web--carabiner-8l>: HTTP status code is not handled or not allowed
2026-01-10 20:55:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sc-ba95110li-led-for-n5-series-110v-clear>: HTTP status code is not handled or not allowed
2026-01-10 20:55:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/toner-fhll8250cdn-mg>: HTTP status code is not handled or not allowed
2026-01-10 20:55:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hd-welded-workbench-60-x-24-adj-height-louvered-panel-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 20:55:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bsm-inc-ada-ss-hand-sink-1-station-with-deck-electronic-faucet-wall-mount-30l-x-17w-x-5d-sink>: HTTP status code is not handled or not allowed
2026-01-10 20:55:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-superglide-fxe-1340cc-motorcycle-battery-1979-1984-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:55:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/34-slit-nozzle-lap-welding-fits-on-07062-reducer>: HTTP status code is not handled or not allowed
2026-01-10 20:55:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bsm-inc-elite-ada-ss-sink-1-station-body-only-wall-mount-36l-x-21w-x-5d-sink>: HTTP status code is not handled or not allowed
2026-01-10 20:55:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fried-hazardgard-sh20m30b-hazardous-location-air-conditioner-19000-btu-cool-97-eer>: HTTP status code is not handled or not allowed
2026-01-10 20:55:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-welded-workbench-48-x-30-louvered-panel-butcher-block-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 20:55:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motobecane-booster-50cc-motorcycle-replacement-battery-1942-1984-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:55:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dmm-s13n-7ll1-dm-dual-mag-dual-led-stereomicroscope-wlight-stand-10x-30x>: HTTP status code is not handled or not allowed
2026-01-10 20:55:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/harley-davidson-night-rod-vrsc-1250cc-motorcycle-battery-2008-2013-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:55:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/289940000-graduated-pitcher-polypropylene-5000ml>: HTTP status code is not handled or not allowed
2026-01-10 20:55:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/atk-450-dirt-track-450cc-motorcycle-replacement-battery-2008-2009-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:55:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bin-cabinet-flush-door-with-185-blue-bins-16-ga-all-welded-cabinet-60-w-x-24-d-x-84-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:55:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bsm-inc-ada-ss-sink-2-station-body-only-floor-mount-sloped-drain-60l-x-20w-x-6d-sink>: HTTP status code is not handled or not allowed
2026-01-10 20:55:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/boreem-jia-602-d-mobility-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:55:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gssafe-1702-class-2-heavy-duty-safety-vest-orange-3xl>: HTTP status code is not handled or not allowed
2026-01-10 20:55:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-welded-workbench-72-x-30-pegboard-panel-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 20:55:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bsm-inc-ada-ss-sink-1-station-body-only-floor-mount-sloped-drain-40l-x-20w-x-6d-sink>: HTTP status code is not handled or not allowed
2026-01-10 20:55:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bsm-inc-ada-ss-sink-4-station-with-electronic-faucet-wall-mount-108l-x-20w-x-6d-sink>: HTTP status code is not handled or not allowed
2026-01-10 20:55:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gssafe-1701-class-2-heavy-duty-safety-vest-lime-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:55:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/si-a536-abi-digital-vortex-genie-vortex-mixer-120v>: HTTP status code is not handled or not allowed
2026-01-10 20:55:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/voyager-gt-overboots-with-heels-cleated-outsole-3xl-12h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:55:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/si-1612-250ml-flask-clamp>: HTTP status code is not handled or not allowed
2026-01-10 20:55:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/workbench-48-x-24-2-drawers-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 20:55:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/meyra-2482adult-mobility-scooter-replacement-battery-55ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:55:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/workbench-48-x-24-louvered-panel--1-drawer-steel-square-edge>: HTTP status code is not handled or not allowed
2026-01-10 20:55:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/summit-ct661cssada-ada-compliant-built-in-undercounter-refrigerator-freezer-51-cu-ft-24w>: HTTP status code is not handled or not allowed
2026-01-10 20:55:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/summit-ct661biif-built-in-undercounter-refrigerator-freezer-51-cu-ft-24-wide>: HTTP status code is not handled or not allowed
2026-01-10 20:55:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mobile-hd-workbench-with-pegboard-adj-height-72w-x-36d-x-65h-3600-lb-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:55:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/summit-swc3066-built-in-undercounter-dual-zone-wine-cellar-led-lighting-led-lighting-30-wide>: HTTP status code is not handled or not allowed
2026-01-10 20:55:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/razor-sx500-dirt-rocket-electric-scooter-replacement-battery-8ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:55:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/summit-ct663bsshhada-ada-compliant-freestanding-refrigerator-freezer-51-cu-ft-24-wide>: HTTP status code is not handled or not allowed
2026-01-10 20:55:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-stp-stl-safet-stair-slp-roll-lad-wt-actu-16-perf-stp-wa-sw52414p>: HTTP status code is not handled or not allowed
2026-01-10 20:55:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-stp-stl-safet-stair-slp-roll-lad-wt-actu-24-serr-stp-wa-sw123214g>: HTTP status code is not handled or not allowed
2026-01-10 20:55:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7-stp-stl-all-direct-safet-roll-lad-wt-actu-24-serr-stp-wa-ad-073214g>: HTTP status code is not handled or not allowed
2026-01-10 20:55:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-cl1385s-4-1-2dia-x-52h-green-w-white-tape>: HTTP status code is not handled or not allowed
2026-01-10 20:56:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9-stp-stl-safet-roll-lad-wt-actu-stp-24-expan-stp-wa093214x>: HTTP status code is not handled or not allowed
2026-01-10 20:56:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-cl1386pnt72-7dia-x-72h-brown-w-no-tape>: HTTP status code is not handled or not allowed
2026-01-10 20:56:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-4502yw-12-3-4dia-x-60h-yellow-w-white-tape>: HTTP status code is not handled or not allowed
2026-01-10 20:56:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-42w-x-21d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelate-24w-x-21d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rascal-liteway224-mobility-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:56:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-cl1385uu-4-1-2dia-x-52h-brown-w-no-tape>: HTTP status code is not handled or not allowed
2026-01-10 20:56:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-cl1386-a-7dia-x-60h-yellow-w-red-tape>: HTTP status code is not handled or not allowed
2026-01-10 20:56:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/motofino-mf125qt-2-125cc-scooter-and-moped-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:56:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rear-rplcmnt-blade-red-gum-2x14x49-316-17-holes-20-10058>: HTTP status code is not handled or not allowed
2026-01-10 20:56:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/leisure-lift-espree-mobility-scooter-replacement-battery-35ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:56:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/front-rplcmnt-blade-red-gum-3-12x38x58-58-10-holes-18-slots-1035067>: HTTP status code is not handled or not allowed
2026-01-10 20:56:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z-rack-garment-storage-rack-z7272-1-1-crossbar-75-x-23-x-78>: HTTP status code is not handled or not allowed
2026-01-10 20:56:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z-rack-garment-storage-rack-z6072-2-2-crossbars-63-x-23-x-78>: HTTP status code is not handled or not allowed
2026-01-10 20:56:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h-rack-garment-storage-rack-h4848-1-1-crossbar-51-x-23-x-54>: HTTP status code is not handled or not allowed
2026-01-10 20:56:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z1395-34x4-non-freeze-yard-hydrant-exposed-34-x-4>: HTTP status code is not handled or not allowed
2026-01-10 20:56:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22502 pages (at 99 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:56:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-60w-x-21d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/linen-storage-unit-locker-llewlsu-gosv-silvervein-31-x-21-1-4-x-84-1-2>: HTTP status code is not handled or not allowed
2026-01-10 20:56:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z1395-34x2-non-freeze-yard-hydrant-exposed-34-x-2>: HTTP status code is not handled or not allowed
2026-01-10 20:56:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-rise-change-tray-for-big-reach-drawers>: HTTP status code is not handled or not allowed
2026-01-10 20:56:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zapworld-zappyturbo-electric-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:56:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/invacare-zoom-hmv-300-mobility-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:56:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-42w-x-24d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-mailbox-spira-m001blk-10-w-x-18-d-x-17-1-2-h-matte-black>: HTTP status code is not handled or not allowed
2026-01-10 20:56:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/eco-funnel-ef-8-sw-8-with-70mm-cap-5-gal-samson-stacker-red-lid>: HTTP status code is not handled or not allowed
2026-01-10 20:56:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-42w-x-18d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/imc-heartway-nomad-pt3-mobility-scooter-replacement-battery-5ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:56:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/z-scooters-z-cruiserx-electric-scooter-replacement-battery-12ah-12v-f2>: HTTP status code is not handled or not allowed
2026-01-10 20:56:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hook-talker-upc-label-holder-10-to-11l>: HTTP status code is not handled or not allowed
2026-01-10 20:56:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magnetic-hook-1-14dia-14-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:56:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-30w-x-21d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/e-boarder-powersonic-electric-scooter-replacement-battery-22ah-12v-nb>: HTTP status code is not handled or not allowed
2026-01-10 20:56:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u874-cantilever-rack-single-sided-upright-74d-x-8h11600-lbs-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:56:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-54w-x-18d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sticky-strip-ss-12-12-position>: HTTP status code is not handled or not allowed
2026-01-10 20:56:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-42w-x-24d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-style-acrylic-signholder-bottom-loading-5w-x-7h>: HTTP status code is not handled or not allowed
2026-01-10 20:56:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-grand-touring-le-ace-900-900cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:56:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/c-channel-1-14-x-48l-white>: HTTP status code is not handled or not allowed
2026-01-10 20:56:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/polaris-iq-touring-euro-750cc-snowmobile-replacement-battery-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:56:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelate-72w-x-21d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hook-loop-fastener-58-tape-58-loop-black>: HTTP status code is not handled or not allowed
2026-01-10 20:56:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelate-60w-x-36d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/du20106-ns-cantilever-rack-double-sided-upright-106w-x-20h>: HTTP status code is not handled or not allowed
2026-01-10 20:56:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peel-stick-literature-pockets-4-116w-x-5h-x-1-14d>: HTTP status code is not handled or not allowed
2026-01-10 20:56:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u2061-ns-cantilever-rack-single-sided-upright-61w-x-20h>: HTTP status code is not handled or not allowed
2026-01-10 20:56:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/u1249-ns-cantilever-rack-single-sided-upright-49w-x-12h>: HTTP status code is not handled or not allowed
2026-01-10 20:56:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peel-n-stick-strip-header-3-78w-x-3-716h>: HTTP status code is not handled or not allowed
2026-01-10 20:56:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelate-60w-x-30d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/peel-stick-literature-pockets-8-58w-x-7h-x-1-14d>: HTTP status code is not handled or not allowed
2026-01-10 20:56:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-summit-highmark-x-800-800cc-snowmobile-battery-2001-2004-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:56:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cell-phone-locker-uvq1044-8-door-24-x-4-x-13-1-2-cherry-black-door-w-hasp-lock>: HTTP status code is not handled or not allowed
2026-01-10 20:56:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hang-tab-system-716-hole-dia-1w-x-1-516h>: HTTP status code is not handled or not allowed
2026-01-10 20:56:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/econo-strip-extra-long>: HTTP status code is not handled or not allowed
2026-01-10 20:56:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bombardier-expedition-sport-550f-550cc-snowmobile-battery-2015-2018-12v>: HTTP status code is not handled or not allowed
2026-01-10 20:56:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-expedition-le-1200-1170cc-snowmobile-replacement-battery-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:56:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/econo-extra-large-header-strip>: HTTP status code is not handled or not allowed
2026-01-10 20:56:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-54w-x-14d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/load-wheel-kit-for-manual-pallet-jack-gwk-jetl-lw-fits-jet-model-l>: HTTP status code is not handled or not allowed
2026-01-10 20:56:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/complete-wheel-kit-for-manual-pallet-jack-gwk-lcr-ck-fits-lift-rite-model-titan-series>: HTTP status code is not handled or not allowed
2026-01-10 20:56:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/econo-line-shelf-dividers-3h-17-916-depth>: HTTP status code is not handled or not allowed
2026-01-10 20:56:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-gtx-550f-550cc-snowmobile-replacement-battery-2005-2008-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:56:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/the-max-peg-hook-strip>: HTTP status code is not handled or not allowed
2026-01-10 20:56:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ski-doo-tundra-300f-300cc-snowmobile-replacement-battery-2006-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:56:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-48w-x-36d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-ski-doo-summit-x-995cc-snowmobile-replacement-battery-2007-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:56:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/arctic-cat-panther-440-snowmobile-replacement-battery-1977-2003-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:56:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/replacement-wheels-for-global-36-blower-fan-model-258320-600595>: HTTP status code is not handled or not allowed
2026-01-10 20:56:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/brp-legend-380f-368cc-snowmobile-replacement-battery-2002-2003-12v-b>: HTTP status code is not handled or not allowed
2026-01-10 20:56:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-54w-x-24d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-counter-height-storage-cabinet-4218dlx-03-welded-36w-x-18d-x-42h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:56:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelate-72w-x-14d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vfts-1830-18-x-30-18-ga-stainless-filler-table-with-1-12-turnup-galvanized-base>: HTTP status code is not handled or not allowed
2026-01-10 20:56:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelate-48w-x-18d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mtr20-39-k-retractable-awning-right-motor-20-w-x-10-d-x-10-h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:56:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dm12-12-bbw-manual-retractable-awning-12-w-x-10-d-x-10-h-blue-white>: HTTP status code is not handled or not allowed
2026-01-10 20:56:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ba-fans-basic-6-ceiling-fan-16-ft-208v-1ph>: HTTP status code is not handled or not allowed
2026-01-10 20:56:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ba-fans-airgo-portable-fan-96-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:56:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ba-fans-aireye-directional-fan-with-swivel-mount-20-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:56:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ba-fans-aireye-directional-fan-with-wall-mount-20-inch>: HTTP status code is not handled or not allowed
2026-01-10 20:56:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/handheld-scraper-3-inch-stainless-steel-white>: HTTP status code is not handled or not allowed
2026-01-10 20:56:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5-drawer-steel-flat-file-for-36-48-documents-white>: HTTP status code is not handled or not allowed
2026-01-10 20:56:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vestil-steel-magnetic-spreader-beam-96l-1000-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:56:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-poly-green-36w-x-18d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-b41-5l440-v-belt-5-8-x-44>: HTTP status code is not handled or not allowed
2026-01-10 20:56:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magliner-industrial-bulk-delivery-truck-6-wheels-1800-lb-cap-987655>: HTTP status code is not handled or not allowed
2026-01-10 20:56:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/element-classic-roll-towel-dispenser-classic-black-t950tbk>: HTTP status code is not handled or not allowed
2026-01-10 20:56:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-24w-x-18d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-a97-4l990-v-belt-1-2-x-99>: HTTP status code is not handled or not allowed
2026-01-10 20:56:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelite-42w-x-24d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:56:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelite-30w-x-21d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-36w-x-14d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:56:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8249z-s-hi-vis-surveyors-vest-class-2-economy-single-size-4xl-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:56:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mth1-2230-ah-heavy-duty-machine-table-adjustable-height>: HTTP status code is not handled or not allowed
2026-01-10 20:56:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8246z-s-two-tone-mesh-hi-vis-safety-vest-class-2-single-size-4xl-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:56:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-7040-cut-resistant-food-grade-gloves-m-lime-1-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:56:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8215ba-s-breakaway-mesh-hi-vis-safety-vest-class-2-economy-s-lime>: HTTP status code is not handled or not allowed
2026-01-10 20:56:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/glowear-8246z-s-two-tone-mesh-hi-vis-safety-vest-class-2-single-size-l-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:56:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/skullerz-8975v-class-c-safety-helmet-with-visor-kit-anti-fog-clear-lens-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:57:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-72w-x-24d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-b220-v-belt-5-8-x-223>: HTTP status code is not handled or not allowed
2026-01-10 20:57:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelite-60w-x-24d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-lockout-padlock-keyed-different-1-1-2-plastic-steel-green>: HTTP status code is not handled or not allowed
2026-01-10 20:57:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-c44-v-belt-7-8-x-48>: HTTP status code is not handled or not allowed
2026-01-10 20:57:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/safety-lockout-padlock-keyed-alike-1-1-2-plastic-steel-red-24-pk>: HTTP status code is not handled or not allowed
2026-01-10 20:57:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/supply-144-bulk-lamp-recycling-kit>: HTTP status code is not handled or not allowed
2026-01-10 20:57:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pump-motor-ejmm3615t-3-phase-5-hp-208-230-460-volts-1750-rpm-60-hz-tefc-184jm>: HTTP status code is not handled or not allowed
2026-01-10 20:57:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelite-60w-x-18d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/px-b256-v-belt-5-8-x-259>: HTTP status code is not handled or not allowed
2026-01-10 20:57:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rackguard-3-w-x-1-13-16-d-x-23-1-2-h-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:57:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-motor-208-230-460-v-5-hp-3450-rpm-3-ph-182tc-opsb>: HTTP status code is not handled or not allowed
2026-01-10 20:57:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3702-brandy-glass-snifter-embassy-55-oz-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:57:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/7512-glass-vina-martini-8-oz-12-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:57:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-ecp83769t-5-3-ph-75-hp-575-v-3510-rpm-tefc-213t-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-48w-x-18d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rb-masterwrap-hd-xl-semi-automatic-rotary-arm>: HTTP status code is not handled or not allowed
2026-01-10 20:57:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22602 pages (at 100 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:57:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pro-linea-u-desk-white>: HTTP status code is not handled or not allowed
2026-01-10 20:57:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/vital-id-self-laminating-helmet-id-stickers-25-stickers-pack-20-packs-box>: HTTP status code is not handled or not allowed
2026-01-10 20:57:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-black-epoxy-54w-x-18d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/usb-rechargeable-edc-flashlight-320-lumens-black>: HTTP status code is not handled or not allowed
2026-01-10 20:57:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tb108-turnbuckle-body-carbon-3-4-10-dia-x-8-7-16-l>: HTTP status code is not handled or not allowed
2026-01-10 20:57:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-30w-x-18d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-phase-motor-em3711t-5-3490-hp-10-rpm-215t-frame-foot-mount-tefc-575-volts>: HTTP status code is not handled or not allowed
2026-01-10 20:57:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ken-forging-tb105-j-j-j-hdg-turnbuckle-assembly-jaw-jaw-1-2-13-x-19-3-4-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 20:57:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ken-forging-tb103-j-e-turnbuckle-assembly-jaw-eye-3-8-16-x-11-7-8-carbon>: HTTP status code is not handled or not allowed
2026-01-10 20:57:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolution-deluxe-6161-full-brim-hard-hat-hdpe-shell-6-pt-polyester-suspension-ratchet-adj-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:57:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-black-epoxy-42w-x-21d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ken-forging-tb105-s-hdg-turnbuckle-assembly-stub-stub-1-2-13-x-14-galvanized>: HTTP status code is not handled or not allowed
2026-01-10 20:57:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washdown-motor-cesswdm3610t-3-ph-3-hp-3500-rpm-208-230-460-v-tefc-182tc-fr>: HTTP status code is not handled or not allowed
2026-01-10 20:57:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-72wx18dx69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-motor-230-460-v-60-hp-1780-rpm-3-ph-364t-dp>: HTTP status code is not handled or not allowed
2026-01-10 20:57:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-poly-green-36wx24dx60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/general-purpose-motor-230-460-v-60-hp-1185-rpm-3-ph-404t-opsb>: HTTP status code is not handled or not allowed
2026-01-10 20:57:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sant33-4k-window-entry-awning-4-3-8-w-x-3-11-16-h-x-3-d-black>: HTTP status code is not handled or not allowed
2026-01-10 20:57:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evo-6151-ascend-short-brim-safety-helmet-hdpe-shell-6-pt-suspension-wheel-ratchet-adj-white>: HTTP status code is not handled or not allowed
2026-01-10 20:57:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-heavy-duty-wheel-zp61rt-325-6x200-1-2bb-x-2-1-2-centered-hub-rib-tread>: HTTP status code is not handled or not allowed
2026-01-10 20:57:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dynamic-dom-cap-style-dome-hard-hat-hdpe-shell-4-pt-suspension-rachet-adjustment-white>: HTTP status code is not handled or not allowed
2026-01-10 20:57:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k530-pathfinder-atv-tire-1010-4pf-i-at22x10-10-4ply>: HTTP status code is not handled or not allowed
2026-01-10 20:57:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washdown-motor-cesswdm3554t-3-ph-15-hp-1760-rpm-208-230-460-v-tefc-145tc-fr>: HTTP status code is not handled or not allowed
2026-01-10 20:57:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evolution-deluxe-6161-full-brim-hard-hat-hdpe-shell-6-pt-suspension-ratchet-adjustment-red>: HTTP status code is not handled or not allowed
2026-01-10 20:57:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-30wx21dx80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelon-60w-x-21d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/k398a-polar-trac-snow-thrower-tire-408-2stt-i-480-400-8-2-ply>: HTTP status code is not handled or not allowed
2026-01-10 20:57:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sti-6251-aed-cabinet-alarm-stop-sign>: HTTP status code is not handled or not allowed
2026-01-10 20:57:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-ecp84111t-5-3-ph-25-hp-575-v-1180-rpm-tefc-324t-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2103s-rotating-literature-display-w-12-wire-pockets-heavy-duty-base-black>: HTTP status code is not handled or not allowed
2026-01-10 20:57:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-ecp84316t-5-3-ph-75-hp-575-v-1780-rpm-tefc-365t-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-60wx21dx80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-48w-x-14d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/all-weather-steel-diskus-padlock-24ib60-ka-keyed-alike-price-per-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:57:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dry-bath-block-20x10mm-test-tubes-or-20x2-0ml-centrifuge-tubes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-42w-x-14d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-vecp3587t-4-3-ph-2-hp-460-v-1755-rpm-tefc-145tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dc-explosion-proof-motor-cdpx3436-075-hp-1750-rpm-xpfc-56c>: HTTP status code is not handled or not allowed
2026-01-10 20:57:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/severe-duty-motor-vecp83583t-4-3-ph-15-hp-460-v-3450-rpm-tefc-143tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/optional-propeller-stainless-steel-one-line-for-overhead-stirrers>: HTTP status code is not handled or not allowed
2026-01-10 20:57:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-ehm2515t-8-3-ph-20-hp-200-v-1765-rpm-opsb-256t-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-ehm3714t-5-3-ph-10-hp-575-v-1770-rpm-tefc-215t-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-em3207t-g-3-ph-15-hp-208-230-460-v-1200-rpm-odp-182t-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s59-4016d-point-of-use-thermostatic-mixing-valve-15-gpm>: HTTP status code is not handled or not allowed
2026-01-10 20:57:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hvac-motor-ehm2334t-5-3-ph-20-hp-575-v-1765-rpm-tefc-256t-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-60w-x-14d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-poly-green-54w-x-24d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-5-inch-circular-nylon-brush-for-gvc-models-390-1100-1250-1502-3-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:57:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rolling-mortar-tub-w-8-inch-high-performance-elastomer-caster-6-6-cu-ft-capacity-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:57:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/15-degree-downward-tilt-bracket-for-lcd-guardian-enclosures-black>: HTTP status code is not handled or not allowed
2026-01-10 20:57:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/machined-chrome-steel-needle-roller-bearing-w-inner-ring-130-x-180-x-50mm>: HTTP status code is not handled or not allowed
2026-01-10 20:57:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-60wx24dx80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-48w-x-24d-x-69h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scalebreak-liquid-descaler-for-stainle-steel-30-gal-drum>: HTTP status code is not handled or not allowed
2026-01-10 20:57:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/scalebreak-descaling-solution-orange-55-gal-drum>: HTTP status code is not handled or not allowed
2026-01-10 20:57:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wd-3-rail-hand-railkick-plate-per-linear-foot>: HTTP status code is not handled or not allowed
2026-01-10 20:57:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelon-72w-x-21d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wd-industrial-steel-mezzanine-11w-x-31-5d-x-8h-clearance>: HTTP status code is not handled or not allowed
2026-01-10 20:57:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-60wx14dx60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-24wx18dx60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wd-stair-landing-platform-expanded-metal>: HTTP status code is not handled or not allowed
2026-01-10 20:57:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/24-inch-long-flexible-arm-5-watt-led-task-lamp-w-quick-disconnect-coupler-base-white>: HTTP status code is not handled or not allowed
2026-01-10 20:57:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-poly-green-48w-x-18d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/8-step-alum-wheel-barrow-roll-ladd-24-14-plat-ribbed-wlartr108244>: HTTP status code is not handled or not allowed
2026-01-10 20:57:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-poly-green-60wx18dx60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/multi-level-steel-shelf-truck-with-4-shelves-36-x-24-800-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:57:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-deep-tray-steel-stock-cart-30x16-800-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:57:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-shelf-deep-tray-steel-stock-cart-36x24-800-lb-capacity>: HTTP status code is not handled or not allowed
2026-01-10 20:57:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/permanent-magnet-motor-cspm3611t-3-ph-230-460-v-3-hp-1800-rpm-tefc-182tc-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:57:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-poly-green-54wx21dx80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-36w-x-18d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/job-site-cabinet-2-doors-52-cu-ft-steel-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:57:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/evap-cooling-bandana-w-cooling-towel-h-l-solid-blue-12577>: HTTP status code is not handled or not allowed
2026-01-10 20:57:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sk-sk2000-seismic-pallet-rack-step-beam-5-1-2-x-108-7320-lbs-capacity-per-pair-pair>: HTTP status code is not handled or not allowed
2026-01-10 20:57:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/classic-trapper-hat-l-xl-black-16845>: HTTP status code is not handled or not allowed
2026-01-10 20:57:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/import-5-16-18-transfer-screw-set>: HTTP status code is not handled or not allowed
2026-01-10 20:57:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-42w-x-18d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-poly-green-48w-x-18d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:57:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/125-orange-woven-polyester-strap-x-600-ftcoil3835-lbs-system-strength-423110>: HTTP status code is not handled or not allowed
2026-01-10 20:57:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ultratech-gloves-nitrile-cut-a4-impact-1-abrasion-4-puncture-4-gray-black-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:57:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-24w-x-24d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:57:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/line-regenerative-dc-control-accessory-bc258-auto-manual-switch-for-bc254>: HTTP status code is not handled or not allowed
2026-01-10 20:58:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/predator-gloves-impact-2-insulated-15-gauge-hi-vis-hpt-palm-coated-yellow-black-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:58:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-72w-x-24d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:58:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-24w-x-21d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:58:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-pump-0-5-hp-1-gallon-3-way-3-position-manual-valve>: HTTP status code is not handled or not allowed
2026-01-10 20:58:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/encoder-feedback-kit-no-encoder-417708-202-dpfv-tebc-fl-rl280-l400>: HTTP status code is not handled or not allowed
2026-01-10 20:58:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/low-profile-hydraulic-cylinder-kit-10-ton-1-5-stroke>: HTTP status code is not handled or not allowed
2026-01-10 20:58:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-42w-x-21d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:58:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/adjustable-motor-base-b182t-182t-3-8-x-1-1-2-bolt-size-w-1-adjustable-screw>: HTTP status code is not handled or not allowed
2026-01-10 20:58:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/rubber-hydraulic-hose-1-4-id-10-l-3-8-18-nptf>: HTTP status code is not handled or not allowed
2026-01-10 20:58:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awn-h23-5cop-seam-slope-awning-5-8-w-x-3d-x-2h-metal>: HTTP status code is not handled or not allowed
2026-01-10 20:58:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/awn-rr22-8l-window-entry-awning-8-4-1-2-w-x-2d-x-2-7-h-linen>: HTTP status code is not handled or not allowed
2026-01-10 20:58:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/uncorded-disposable-earplugs-pvc-foam-orange-30-db-200-pairs>: HTTP status code is not handled or not allowed
2026-01-10 20:58:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/double-acting-hydraulic-cylinder-30-ton-14-stroke>: HTTP status code is not handled or not allowed
2026-01-10 20:58:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/element-03-medical-lab-cart-51498-3-drawers-24-x-19-x-35-white>: HTTP status code is not handled or not allowed
2026-01-10 20:58:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/conduit-box-kit-standard-size-33cb5000a01sp-42-nema-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:58:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22699 pages (at 97 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:58:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/gas-cylinder-air-spring-for-cabinet-41800-and-42000>: HTTP status code is not handled or not allowed
2026-01-10 20:58:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelon-36w-x-24d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:58:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-30w-x-14d-x-60h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:58:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-30w-x-14d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:58:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2517-x-1-7-16-1-7-16-x-24-2517-series-tapered-locking-steel-bushing-1-7-16-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:58:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-60w-x-21d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:58:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-4-shelf-truck-nexelon-72w-x-21d-x-80h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:58:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/h-x-1-1-x-66-h-series-quick-detach-steel-bushing-1-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:58:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/activity-table-height-insert-set-of-4>: HTTP status code is not handled or not allowed
2026-01-10 20:58:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/constant-velocity-blower-cooling-conversion-kit-blwl09-l-1-ph-115v-254tc-256tc-nema-frame>: HTTP status code is not handled or not allowed
2026-01-10 20:58:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sk-x-1-11-16-1-11-16-x-39-sk-series-quick-detach-steel-bushing-1-11-16-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:58:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelon-48w-x-14d-x-69h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:58:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/desktop-indoor-air-quality-carbon-dioxide-meter-with-led-alert-9->: HTTP status code is not handled or not allowed
2026-01-10 20:58:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-3-shelf-truck-nexelon-30w-x-21d-x-60h-polyurethane-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:58:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/compressed-air-hose-90117930-12-mnpt-x-12-mnpt-30-l-x-12-id>: HTTP status code is not handled or not allowed
2026-01-10 20:58:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/waring-cac88-container-with-lid-stainless-steel-32-ounce-blade-collar>: HTTP status code is not handled or not allowed
2026-01-10 20:58:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-first-aid-refill-kit-ansi-compliant-class-b>: HTTP status code is not handled or not allowed
2026-01-10 20:58:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/global-industrial-153-first-aid-refill-kit-25-50-person-ansi-compliant-class-a>: HTTP status code is not handled or not allowed
2026-01-10 20:58:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/celltreat-scientific-products-250l-low-retention-pipette-tips-ovation-vistarak-sterile-960-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/celltreat-scientific-products-250l-pipette-tips-ovation-vistarak-nonsterile-960-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/30in-heavy-duty-exhaust-fan-with-integrated-shutter-if30-5500-cfm>: HTTP status code is not handled or not allowed
2026-01-10 20:58:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nexel-5-shelf-truck-nexelon-60w-x-21d-x-80h-polyurethane-swivel-casters-2-brakes>: HTTP status code is not handled or not allowed
2026-01-10 20:58:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/head-mechanism-150s-m-hd-use-with-150-m>: HTTP status code is not handled or not allowed
2026-01-10 20:58:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/celltreat-scientific-products-25ml-reagent-reservoir-individually-wrapped-sterile-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bolted-teardrop-pallet-rack-add-on-96inw-x-42ind-x-144inh-5030-lbs-shelf-cap>: HTTP status code is not handled or not allowed
2026-01-10 20:58:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sugarcane-fiber-plates-9-9-10-diameter-microwavable-50-pack-white>: HTTP status code is not handled or not allowed
2026-01-10 20:58:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/portable-turbo-electric-heater-120v-1500w>: HTTP status code is not handled or not allowed
2026-01-10 20:58:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/celltreat-scientific-products-50ml-reagent-reservoir-individually-wrapped-sterile-100-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hot-cold-foam-cups-14-oz-1000-carton-white>: HTTP status code is not handled or not allowed
2026-01-10 20:58:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omnicart-cab-36-cap-big-beam-w-locking-panel-beige-49-3-4w-x-17d-x-55-1-8h>: HTTP status code is not handled or not allowed
2026-01-10 20:58:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/omnicart-cab-48-cap-big-beam-w-locking-panel-light-gray-49-3-4w-x-17d-x-70-1-8h>: HTTP status code is not handled or not allowed
2026-01-10 20:58:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/celltreat-scientific-products-15ml-pipette-mla-macro-adjustable>: HTTP status code is not handled or not allowed
2026-01-10 20:58:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/paper-plates-8-1-2-diameter-microwavable-heavy-weight-125-pack-white-pathways-design>: HTTP status code is not handled or not allowed
2026-01-10 20:58:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wasp-ams-kit-2-for-5-channel-wsa-125-kit2-hs>: HTTP status code is not handled or not allowed
2026-01-10 20:58:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commercial-gas-hose-kit-csa-and-ansi-approved-bkg-ghc-5048-sck2>: HTTP status code is not handled or not allowed
2026-01-10 20:58:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-850-thermal-insulated-freezer-gloves-3xl-black>: HTTP status code is not handled or not allowed
2026-01-10 20:58:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manway-gasket-spiral-wound-12-x-16-x-1-1-4-0-25-thick-elliptical-2pk>: HTTP status code is not handled or not allowed
2026-01-10 20:58:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/large-area-dehumidifier-cd425-220v-with-high-capacity-pump-16-amps-1750-cfm-285-pints>: HTTP status code is not handled or not allowed
2026-01-10 20:58:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/proflex-1675-back-support-brace-with-coolingwarming-pack-l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:58:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/48-double-face-shelving-base-37-w-x-24-d-x-47-1-4-h-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:58:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-180-handhole-gasket-358-x-558-x-916-black-rubber-obround-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/air-impact-wrench-friction-ring-retainer-12-drive-12000-max-torque-10-316l>: HTTP status code is not handled or not allowed
2026-01-10 20:58:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/controls-merz-z151-3-aa-change-over-switch-w-zero-pos-3-pole-20a-4-hole-front-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:58:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-x-30-winch-strap-with-41766-18-flat-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:58:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/master-kerosenediesel-forced-air-heater-with-thermostat-140000-btu-120v>: HTTP status code is not handled or not allowed
2026-01-10 20:58:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-2000-manway-gasket-14-x-18-x-112-graphite-elliptical-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/max-m2233-ergonomic-scissor-lift-table-hand-operated-3300-lb-cap-48l-x-36w-115v>: HTTP status code is not handled or not allowed
2026-01-10 20:58:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-180-handhole-gasket-234-x-412-x-12-black-rubber-obround-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/series-e-a-cam-strap-assembly-with-spring-actuated-fitting-16>: HTTP status code is not handled or not allowed
2026-01-10 20:58:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-180-handhole-gasket-314-x-5-x-916-black-rubber-elliptical-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infrared-electric-heater-fss-4320-3-heavy-duty-430-kw-208v>: HTTP status code is not handled or not allowed
2026-01-10 20:58:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cordless-impact-wrench-kit-34-chuck-size-standard-friction-ring-anvil-20v>: HTTP status code is not handled or not allowed
2026-01-10 20:58:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/digital-acrylic-door-incubator-12-140e-235w>: HTTP status code is not handled or not allowed
2026-01-10 20:58:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/magnetic-3-4-circles-20-pack-red>: HTTP status code is not handled or not allowed
2026-01-10 20:58:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/commute-guest-chair-plasticacrylic-seat-25w-x-25d-x-34-34h-black>: HTTP status code is not handled or not allowed
2026-01-10 20:58:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dxs2153-standard-anvil-attachment-38-drive>: HTTP status code is not handled or not allowed
2026-01-10 20:58:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/83132-1035-f1-gas-engine-550-series-tiller-log-splitter-horizontal-shaft>: HTTP status code is not handled or not allowed
2026-01-10 20:58:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-180-manway-gasket-18-x-24-x-112-black-rubber-elliptical-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cl-focus-ii-cylindrical-28-walk-behind-midsize-scrubber-cylindrical-05421a>: HTTP status code is not handled or not allowed
2026-01-10 20:58:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cl-comfort-pak-6-qt-with-tool-kit-backpack-vacuum-9060610010>: HTTP status code is not handled or not allowed
2026-01-10 20:58:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/standard-series-clamp-for-tubing-ssct100-1-inch-id>: HTTP status code is not handled or not allowed
2026-01-10 20:58:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/jurni-multi-purpose-table-with-t-legs--glides-72l-x-24w-x-29h-fusion-maple>: HTTP status code is not handled or not allowed
2026-01-10 20:58:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twin-series-clamp-for-pipe-tscp038-3-8-inch-id>: HTTP status code is not handled or not allowed
2026-01-10 20:58:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/electric-4-way-function-dc-power-unit-pu642-086-gal-poly-reservoir-250-inch-nptf-outlets>: HTTP status code is not handled or not allowed
2026-01-10 20:58:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/filter-assembly-hfa42525-25-micron-25-psi-bypass-1-1-2-inch-npt-2-inch-sae-ports>: HTTP status code is not handled or not allowed
2026-01-10 20:58:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/topoge-series-180-handhole-gasket-312-x-412-x-112-black-rubber-elliptical-2-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/metro-mycart-two-shelf-utility-cart-with-chrome-plated-posts-25x18-shelves>: HTTP status code is not handled or not allowed
2026-01-10 20:58:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/relius-solutions-basket-trucks-by-royal-cotton-canvas-liner-20wx30dx27h-4-swivel-casters>: HTTP status code is not handled or not allowed
2026-01-10 20:58:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mechanix-wear-cg-heavy-duty-black-leather-gloves-extra-large>: HTTP status code is not handled or not allowed
2026-01-10 20:58:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mechanix-wear-original174-work-gloves-synthetic-leather-wtrekdry153-cooling-black-xl>: HTTP status code is not handled or not allowed
2026-01-10 20:58:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hard-scrub-brush-set-for-vortex-18-multi-surface-scrubber-18w-pack-of-2>: HTTP status code is not handled or not allowed
2026-01-10 20:58:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tx4000-esd-cleanroom-apparel-frock-m-navy-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:58:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simpson-armor-hose8482-38-x-100-x-4500-psi-hot-cold-water-replacementextension-hose>: HTTP status code is not handled or not allowed
2026-01-10 20:58:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/combination-nipple-hcn200-2-inch-200-npt-male-thread-200-inch-hose-id-4375-inchl>: HTTP status code is not handled or not allowed
2026-01-10 20:58:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/simpson-professional-pressure-washer-spray-gun-hotcold-water-powered-machines-to-5000-psi>: HTTP status code is not handled or not allowed
2026-01-10 20:58:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/suction-hose-wlh12572-1-1-4-inch-id-x-6-foot-long-hose>: HTTP status code is not handled or not allowed
2026-01-10 20:58:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ma531-protective-glass-for-all-emz-models-except-emz-12-series>: HTTP status code is not handled or not allowed
2026-01-10 20:58:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/s-4200-boom-stand>: HTTP status code is not handled or not allowed
2026-01-10 20:58:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/achim-tivoli-ii-self-adhesive-vinyl-floor-planks-6-x-36-mahogany-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/twin-series-clamp-for-tubing-tsct087-7-8-inch-id>: HTTP status code is not handled or not allowed
2026-01-10 20:58:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/achim-tivoli-self-adhesive-vinyl-floor-tile-12-x-12-ash-grey-wood-45-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:58:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3scf-screw-conveyor-flange-fits-ultimate-shaft-mount-reducer-size-3->: HTTP status code is not handled or not allowed
2026-01-10 20:59:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/t-bolt-clamp-hc125-13-4-inch-nominal-dia-155-inch-min-dia-179-inch-max-dia>: HTTP status code is not handled or not allowed
2026-01-10 20:59:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bulkhead-nut-h5924x8-1-2-inch-tube-od>: HTTP status code is not handled or not allowed
2026-01-10 20:59:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/mgafr400-filter-reg-1-2-npt-5-microns-semi-auto-drain-20-130-psi-poly-bowl>: HTTP status code is not handled or not allowed
2026-01-10 20:59:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4wtbk-2-tapered-bushing-kit-2-fits-reducer-styles-smr4wsmr4>: HTTP status code is not handled or not allowed
2026-01-10 20:59:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ediusa-ballistic-vest-tested-to-level-iiia-ballistic-resistance-xxlarge>: HTTP status code is not handled or not allowed
2026-01-10 20:59:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/smr10-151-shaft-mount-reducer-size-10-151-ratio-5-716-tapered-bore>: HTTP status code is not handled or not allowed
2026-01-10 20:59:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nylon-pallet-rack-netting-1-net-99-x-3-16-x-48-2500-lb-capacity-black>: HTTP status code is not handled or not allowed
2026-01-10 20:59:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9oz-23-fr-sateen-cotton-sleeve-blue-9oz>: HTTP status code is not handled or not allowed
2026-01-10 20:59:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9oz-30-sateen-cotton-jacket-red-2xl>: HTTP status code is not handled or not allowed
2026-01-10 20:59:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9oz-30-sateen-cotton-jacket-orange-m>: HTTP status code is not handled or not allowed
2026-01-10 20:59:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wing-type-quick-detach-hydraulic-coupler-qdwc122-3-4-inch-npt-coupler-18-flow-gpm>: HTTP status code is not handled or not allowed
2026-01-10 20:59:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/9oz-30-sateen-cotton-jacket-red-m>: HTTP status code is not handled or not allowed
2026-01-10 20:59:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stamped-welding-flange-fs200-2-inch-steel-3705-inch-od-0118-inch-thick>: HTTP status code is not handled or not allowed
2026-01-10 20:59:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/fr-cotton-leather-cape-sleeve-apron-w-black-anodized-snap-dark-brown-5xl>: HTTP status code is not handled or not allowed
2026-01-10 20:59:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wing-type-quick-detach-hydraulic-coupler-qdwc241-1-1-2-inch-npt-coupler-100-flow-gpm>: HTTP status code is not handled or not allowed
2026-01-10 20:59:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22796 pages (at 97 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 20:59:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/techstar-sos-storage-bin-5-1-2-cu-ft-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:59:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sa-whiffle-typical-12-triple-60-red>: HTTP status code is not handled or not allowed
2026-01-10 20:59:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/reducer-bushing-h3109x16x6-1-inch-x-1-2-inch-npt-male-to-female>: HTTP status code is not handled or not allowed
2026-01-10 20:59:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/tpi-workstation-fan-18-blade-diameter-18-hp-wall-mount>: HTTP status code is not handled or not allowed
2026-01-10 20:59:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/relius-solutions-panoramic-dome-mirror-full-dome-acrylic-48>: HTTP status code is not handled or not allowed
2026-01-10 20:59:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sa-mirella-low-wall-cabinet-glass-doors-stonegray>: HTTP status code is not handled or not allowed
2026-01-10 20:59:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/under-crib-bin-u110-for-infant-crib-with-o2-tank-c-o>: HTTP status code is not handled or not allowed
2026-01-10 20:59:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sa-mirella-5-shelf-bookshelf-southerntobacco>: HTTP status code is not handled or not allowed
2026-01-10 20:59:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/sa-mirella-storage-cabinet-southerntobacco>: HTTP status code is not handled or not allowed
2026-01-10 20:59:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/infant-icu-crib-e2072cl-klimer-30w-x-44l-x-78h-flat-deck-confetti>: HTTP status code is not handled or not allowed
2026-01-10 20:59:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wearwell-3x39-edging-for-24-seven-mats-cutting-fluid-resistant-rubber-female-edge-black>: HTTP status code is not handled or not allowed
2026-01-10 20:59:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zl1n-l48-3000lm-fst-mvolt-40k-80cri-wh-led-strip-light-3000-lumens-4000k-white->: HTTP status code is not handled or not allowed
2026-01-10 20:59:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lbw-portable-gas-heater-premier-170-df-170k-btu-lpg-ng>: HTTP status code is not handled or not allowed
2026-01-10 20:59:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/zl1n-l48-7000lm-fst-mvolt-40k-80cri-wh-led-strip-light-7000-lumens-4000k-white->: HTTP status code is not handled or not allowed
2026-01-10 20:59:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lbw-portable-gas-heater-workman-100n-plus-100k-btu-ng>: HTTP status code is not handled or not allowed
2026-01-10 20:59:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worldwide-electric-winl87-10-1-254tc-helical-inline-speed-reducer-254tc-input-flange-10-1-ratio>: HTTP status code is not handled or not allowed
2026-01-10 20:59:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hooded-fleece-sweater-14-25-oz-flame-resistant-m-tall-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:59:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/worldwide-electric-winl107-10-1-324-6tchelical-inline-speed-reducer324-6tc-input-flange10-1-ratio>: HTTP status code is not handled or not allowed
2026-01-10 20:59:20 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/full-flow-control-gate-valve-hgv200-2-inch-valve-200-psi-wog-non-shock>: HTTP status code is not handled or not allowed
2026-01-10 20:59:21 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-visibility-athletic-performance-t-shirt-flame-resistant-6-25-oz-2xl-tall-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:59:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ds-327100b-shrink-wrap-32w-x-100l-7mil-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:59:22 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wind-pro-full-zip-hooded-sweater-reflective-flame-resistant-l-tall-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:59:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-32w-x-30l-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:59:23 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ds-177175w-shrink-wrap-17w-x-175l-7mil-white>: HTTP status code is not handled or not allowed
2026-01-10 20:59:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clark-foam-products-1001267-foam-sheet-200100poly-charcoal-1-2x36x36>: HTTP status code is not handled or not allowed
2026-01-10 20:59:24 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/clark-foam-products-1001256-foam-sheet-anti-static-poly-1-1-2x54x82>: HTTP status code is not handled or not allowed
2026-01-10 20:59:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ds-268100w-shrink-wrap-26w-x-100l-8mil-white>: HTTP status code is not handled or not allowed
2026-01-10 20:59:25 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ds-4010100w-shrink-wrap-40w-x-100l-10mil-white>: HTTP status code is not handled or not allowed
2026-01-10 20:59:26 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/wind-pro-full-zip-hooded-sweater-reflective-flame-resistant-2xl-tall-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:59:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5414400-86-5-8h-chrome-post>: HTTP status code is not handled or not allowed
2026-01-10 20:59:27 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5412800-42x18-shelf-zinc-finish>: HTTP status code is not handled or not allowed
2026-01-10 20:59:28 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/long-sleeve-henley-interlock-knit-flame-resistant-l-orange>: HTTP status code is not handled or not allowed
2026-01-10 20:59:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/snap-button-down-long-sleeve-work-shirt-l-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:59:29 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/taper-gage-4630-1-05-10mm-range-005mm-graduation>: HTTP status code is not handled or not allowed
2026-01-10 20:59:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/5473200-maple-top-144in-x36in>: HTTP status code is not handled or not allowed
2026-01-10 20:59:30 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/laptop-tablet-riser-black-red>: HTTP status code is not handled or not allowed
2026-01-10 20:59:31 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/high-vis-full-zip-hooded-sweater-reflective-m-tall-yellow>: HTTP status code is not handled or not allowed
2026-01-10 20:59:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-locker-accessory-slope-top-end-closure-15d-x-5h-729-parchment>: HTTP status code is not handled or not allowed
2026-01-10 20:59:32 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/steel-locker-accessory-individual-slope-top-18w-x-18d-x-6h-725-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:59:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-rotary-base-reference-organizer-10-panel>: HTTP status code is not handled or not allowed
2026-01-10 20:59:33 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/deluxe-rotary-base-reference-organizer-30-panel>: HTTP status code is not handled or not allowed
2026-01-10 20:59:34 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-33w-x-32l-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:59:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-44w-x-36l-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:59:35 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-36w-x-28l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:59:36 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/overhead-tool-trolley-pbtt-72-pb-series-light-duty-for-72-benches-black>: HTTP status code is not handled or not allowed
2026-01-10 20:59:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/underbed-truck-bx-alum-jumbo-16-0-cu-ft-650-0-02>: HTTP status code is not handled or not allowed
2026-01-10 20:59:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/esd-modular-work-bench-adder-c2-spa-e3048-75wgb-c2-series-30d-x-48w-x-75h-white-laminate>: HTTP status code is not handled or not allowed
2026-01-10 20:59:37 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pack-rat-3-compart-drawer-white-48-l-x-30-w-x-12-12-h-337-3>: HTTP status code is not handled or not allowed
2026-01-10 20:59:38 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/traffic-cone-chain-kit-blue-mrc-93206-6>: HTTP status code is not handled or not allowed
2026-01-10 20:59:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/72706sb1-6-mini-srd-single-leg-steel-carabiner-steel-snap-hook>: HTTP status code is not handled or not allowed
2026-01-10 20:59:39 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/500-series-chair-500-nb-ecr-bl-esd-clean-room-vinyl-nylon-base-18-23h-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:59:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-file-drawer-cabinet-2bf-b-double-6-drawers-blue>: HTTP status code is not handled or not allowed
2026-01-10 20:59:40 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/12-capacity-33-lbs-cylinders-galvanized-steel-gas-cylinder-cage-30w-x-44d-x-68h-silver>: HTTP status code is not handled or not allowed
2026-01-10 20:59:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-36w-x-34l-brown>: HTTP status code is not handled or not allowed
2026-01-10 20:59:41 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/galvanized-steel-solid-shelving-add-on-189990>: HTTP status code is not handled or not allowed
2026-01-10 20:59:42 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bollard-cover-7-dia-x-52h-beige-w-no-tape-7x52bgent>: HTTP status code is not handled or not allowed
2026-01-10 20:59:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-36w-x-34l-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:59:43 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-28w-x-32l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:59:44 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/pendant-mount-kit-series-b-27xst-27xl-121x-series>: HTTP status code is not handled or not allowed
2026-01-10 20:59:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/post-kit-63-highsingle-797327>: HTTP status code is not handled or not allowed
2026-01-10 20:59:45 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-50w-x-30l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:59:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-33w-x-29l-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:59:46 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/black-epoxy-wire-shelf-18-x-42-S1842B>: HTTP status code is not handled or not allowed
2026-01-10 20:59:47 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-31w-x-28l-navy>: HTTP status code is not handled or not allowed
2026-01-10 20:59:48 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-42w-x-33l-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:59:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/302-bike-shell-bike-locker-2-bike-cap-74-1-2l-x-40w-x-49h-medium-grey-padlock-handle>: HTTP status code is not handled or not allowed
2026-01-10 20:59:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-38w-x-36l-green>: HTTP status code is not handled or not allowed
2026-01-10 20:59:49 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hand-operated-drum-pump-piston-action-body-material-nylon>: HTTP status code is not handled or not allowed
2026-01-10 20:59:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-36w-x-28l-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:59:50 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-38w-x-32l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:59:51 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/lewiston-mailbox-post-fluted-base-ball-finial-support-brace-no-address-plates-white>: HTTP status code is not handled or not allowed
2026-01-10 20:59:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-29w-x-33l-tan>: HTTP status code is not handled or not allowed
2026-01-10 20:59:52 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-42w-x-33l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:59:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/stucco-cbu-mailbox-center-short-pedestal-column-only-in-slate-gray-color-with-bayview-solar-lamp>: HTTP status code is not handled or not allowed
2026-01-10 20:59:53 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-40w-x-36l-gray>: HTTP status code is not handled or not allowed
2026-01-10 20:59:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/cardboard-single-wall-corrugated-box-40-x-30-x-30-200lb-test-ect-32-kraft-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:59:54 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/white-literature-mailers-10-x-8-x-3-200lb-test-ect-32-b-50-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:59:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/heavy-duty-double-wall-cardboard-corrugated-box-22-x-18-x-16-275-lb-ect-48-10-pack>: HTTP status code is not handled or not allowed
2026-01-10 20:59:55 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/model-3000-heat-gun-kit-with-cool-nozzle-swivel-fitting>: HTTP status code is not handled or not allowed
2026-01-10 20:59:56 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-42w-x-36l-black>: HTTP status code is not handled or not allowed
2026-01-10 20:59:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-4-inch-drive-dial-electronic-torque-wrench-60-600-ft-lbs>: HTTP status code is not handled or not allowed
2026-01-10 20:59:57 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/la-23-15-70mm-stack-light-flashing-120v-acdc-bulb-amber>: HTTP status code is not handled or not allowed
2026-01-10 20:59:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-50w-x-36l-green>: HTTP status code is not handled or not allowed
2026-01-10 20:59:58 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/3-8-inch-drive-socket-9-16-inch-12-point-1-1-8-inch-l>: HTTP status code is not handled or not allowed
2026-01-10 20:59:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/la-tcl03sb532-70mm-complete-light-stack-24v-led-gray-term-g-a-r>: HTTP status code is not handled or not allowed
2026-01-10 20:59:59 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/la-tcl95ab95632-70mm-light-stack-24v-led-blk-term-w-g-b-a-r-100-db>: HTTP status code is not handled or not allowed
2026-01-10 21:00:00 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/la-tcl04sb5632-70mm-complete-light-stack-24v-led-gray-term-g-b-a-r>: HTTP status code is not handled or not allowed
2026-01-10 21:00:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/1-4-inch-drive-deep-socket-8-mm-6-point>: HTTP status code is not handled or not allowed
2026-01-10 21:00:01 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-1-2-inch-drive-impact-socket-5-3-8-inch-6-point-7-3-4-inch-l>: HTTP status code is not handled or not allowed
2026-01-10 21:00:02 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-58w-x-29l-navy>: HTTP status code is not handled or not allowed
2026-01-10 21:00:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-48w-x-30l-navy>: HTTP status code is not handled or not allowed
2026-01-10 21:00:03 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/dieless-mechanical-compression-tool-crimps-8-250-kcmil-aluminum-or-copper>: HTTP status code is not handled or not allowed
2026-01-10 21:00:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/411-piece-aircraft-maintenance-set>: HTTP status code is not handled or not allowed
2026-01-10 21:00:04 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/nta1018-needle-bearing-thrust-roller-assembly-bore-15875mm>: HTTP status code is not handled or not allowed
2026-01-10 21:00:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/manchester-stucco-locking-column-mailbox-in-burnt-tuscan-w-decorative-scroll-door-in-bronze>: HTTP status code is not handled or not allowed
2026-01-10 21:00:05 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-42w-x-36l-black>: HTTP status code is not handled or not allowed
2026-01-10 21:00:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-54w-x-28l-black>: HTTP status code is not handled or not allowed
2026-01-10 21:00:06 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/b610-oh-needle-bearing-drawn-cup-full-complement-oil-hole-bore-9525mm>: HTTP status code is not handled or not allowed
2026-01-10 21:00:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/bright-hues-feather-assortment-325-pieces-pack>: HTTP status code is not handled or not allowed
2026-01-10 21:00:07 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-50w-x-36l-navy>: HTTP status code is not handled or not allowed
2026-01-10 21:00:08 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/washable-markers-conical-tip-nontoxic-assorted-8-set>: HTTP status code is not handled or not allowed
2026-01-10 21:00:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/hk1210-needle-bearing-drawn-cup-caged-metric-bore-11989mm>: HTTP status code is not handled or not allowed
2026-01-10 21:00:09 [scrapy.extensions.closespider] (PID: 62) INFO: Closing spider since no items were produced in the last 1800 seconds.
2026-01-10 21:00:09 [scrapy.core.engine] (PID: 62) INFO: Closing spider (closespider_timeout_no_item)
2026-01-10 21:00:09 [scrapy.extensions.logstats] (PID: 62) INFO: Crawled 22898 pages (at 102 pages/min), scraped 7042 items (at 0 items/min)
2026-01-10 21:00:09 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-46w-x-36l-black>: HTTP status code is not handled or not allowed
2026-01-10 21:00:10 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/regular-fit-work-pants-52w-x-31l-navy>: HTTP status code is not handled or not allowed
2026-01-10 21:00:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/el11318-1hp-56h-frame-1800rpm-115-230v-odp-rigid-premium-efficiency>: HTTP status code is not handled or not allowed
2026-01-10 21:00:11 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-36w-x-34l-black>: HTTP status code is not handled or not allowed
2026-01-10 21:00:12 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pocket-cargo-pants-heavy-duty-twill-50w-x-34l-navy>: HTTP status code is not handled or not allowed
2026-01-10 21:00:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/2-inch-self-adhesive-letters-black-159-characters-set>: HTTP status code is not handled or not allowed
2026-01-10 21:00:13 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pocket-cargo-pants-heavy-duty-twill-52w-x-30l-gray>: HTTP status code is not handled or not allowed
2026-01-10 21:00:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/4-inch-playful-combo-ready-letters-black-1-set>: HTTP status code is not handled or not allowed
2026-01-10 21:00:14 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pocket-cargo-pants-heavy-duty-twill-50w-x-30l-black>: HTTP status code is not handled or not allowed
2026-01-10 21:00:15 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/el11209-5hp-48-frame-1800rpm-115-230v-odp-rigid-premium-efficiency>: HTTP status code is not handled or not allowed
2026-01-10 21:00:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/premium-low-rise-fit-work-pants-60w-x-31l-navy>: HTTP status code is not handled or not allowed
2026-01-10 21:00:16 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/alphabet-match-me-cards-3-inch-x-4-inch-52-cards-box>: HTTP status code is not handled or not allowed
2026-01-10 21:00:17 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/ergonomic-handle-magnet-100-lbs-pull-45l-x-1w-x-3375h>: HTTP status code is not handled or not allowed
2026-01-10 21:00:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/post-medical-2-quart-leak-tight-sharps-container-with-locking-screw-cap-red-12-cs>: HTTP status code is not handled or not allowed
2026-01-10 21:00:18 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/miller-aircore-harness-quick-connect-buckle-green-ac-qcugn-436836>: HTTP status code is not handled or not allowed
2026-01-10 21:00:19 [scrapy.spidermiddlewares.httperror] (PID: 62) INFO: Ignoring response <403 https://www.globalindustrial.com/p/6-pocket-cargo-pants-heavy-duty-twill-32w-x-34l-navy>: HTTP status code is not handled or not allowed
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... FAIL
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.)
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... OK
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... FAIL
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... FAIL
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... OK
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... SKIPPED (Unable to find 'downloader/exception_count' in job stats.)
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] ----------------------------------------------------------------------
2026-01-10 21:00:19 [global_industrial] (PID: 62) ERROR: [Spidermon] 
======================================================================
FAIL: Extracted Items Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'item_scraped_count' to be '>=' to '100000.0'. Current value: '7042'

2026-01-10 21:00:19 [global_industrial] (PID: 62) ERROR: [Spidermon] 
======================================================================
FAIL: Warning Count Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'log_count/WARNING' to be '<=' to '2.0'. Current value: '731'

2026-01-10 21:00:19 [global_industrial] (PID: 62) ERROR: [Spidermon] 
======================================================================
FAIL: Finish Reason Monitor/Should have the expected finished reason(s)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 110, in test_should_finish_with_expected_reason
    self.assertTrue(finished_reason in expected_reasons, msg=msg)
AssertionError: Finished with "closespider_timeout_no_item" the expected reasons are ['finished']

2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] 11 monitors in 0.007s
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] FAILED (failures=3, skipped=2)
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] -------------------------- FINISHED ACTIONS --------------------------
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] ----------------------------------------------------------------------
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] 0 actions in 0.000s
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] OK
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] --------------------------- PASSED ACTIONS ---------------------------
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] ----------------------------------------------------------------------
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] 0 actions in 0.000s
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] OK
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] --------------------------- FAILED ACTIONS ---------------------------
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... ERROR
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] ----------------------------------------------------------------------
2026-01-10 21:00:19 [global_industrial] (PID: 62) ERROR: [Spidermon] 
======================================================================
ERROR: CustomTemplateSendSlackMessageSpiderFinished
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/core/actions.py", line 39, in run
    self.run_action()
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 252, in run_action
    self.manager.send_message(
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 58, in send_message
    return [
           ^
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 59, in <listcomp>
    self.send_message(
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 85, in send_message
    return self._send_channel_message(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 129, in _send_channel_message
    attachments=self._parse_attachments(attachments),
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 171, in _parse_attachments
    python_attachments = ast.literal_eval(attachments)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/ast.py", line 64, in literal_eval
    node_or_string = parse(node_or_string.lstrip(" \t"), mode='eval')
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/ast.py", line 50, in parse
    return compile(source, filename, mode, flags,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<unknown>", line 4
    "text": "•  _Extracted Items Monitor/test_stat_monitor_: Expecting 'item_scraped_count' to be '>=' to '100000.0'. Current value: '7042'\n•  _Warning Count Monitor/test_stat_monitor_: Expecting 'log_count/WARNING' to be '<=' to '2.0'. Current value: '731'\n•  _Finish Reason Monitor/Should have the expected finished reason(s)_: Finished with "closespider_timeout_no_item" the expected reasons are ['finished']\n",
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
SyntaxError: invalid syntax. Perhaps you forgot a comma?

2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] 1 action in 0.223s
2026-01-10 21:00:19 [global_industrial] (PID: 62) INFO: [Spidermon] FAILED (errors=1)
2026-01-10 21:00:20 [scrapy.extensions.feedexport] (PID: 62) INFO: Stored bq feed (42 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:8
2026-01-10 21:00:20 [scrapy.statscollectors] (PID: 62) INFO: Dumping Scrapy stats:
{'HeadersSpooferDownloaderMiddleware/spoofed': 23636,
 'NotFoundHandlerSpiderMiddleware/HttpError': 15476,
 'NotFoundHandlerSpiderMiddleware/NotProductPage': 1584,
 'big_query/url': 22914,
 'downloader/request_bytes': 40671747,
 'downloader/request_count': 23636,
 'downloader/request_method_count/GET': 23636,
 'downloader/response_bytes': 1045648439,
 'downloader/response_count': 23636,
 'downloader/response_status_count/200': 7438,
 'downloader/response_status_count/308': 722,
 'downloader/response_status_count/403': 15476,
 'elapsed_time_seconds': 14410.041582,
 'feedexport/success_count/BigQueryFeedStorage': 8,
 'finish_reason': 'closespider_timeout_no_item',
 'finish_time': datetime.datetime(2026, 1, 10, 21, 0, 19, 669364, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 5029982216,
 'httpcompression/response_count': 7438,
 'httperror/response_ignored_count': 15476,
 'httperror/response_ignored_status_count/403': 15476,
 'item_scraped_count': 7042,
 'items_per_minute': None,
 'log_count/ERROR': 400,
 'log_count/INFO': 15767,
 'log_count/WARNING': 731,
 'memusage/max': 354181120,
 'memusage/startup': 125599744,
 'poet/injector/catalog_extraction.pages.global_industrial.GlobalIndustrialProductsPageObject': 22914,
 'product_status/not_available_online': 2,
 'proxy_manager/ignored/proxy_defined': 722,
 'proxy_manager/processed': 22914,
 'response_received_count': 22914,
 'responses_per_minute': None,
 'scheduler/dequeued': 23636,
 'scheduler/dequeued/memory': 23636,
 'scheduler/enqueued': 23636,
 'scheduler/enqueued/memory': 23636,
 'spider_exceptions/NotProductPage': 396,
 'spidermon/validation/fields': 147882,
 'spidermon/validation/items': 7042,
 'spidermon/validation/validators': 1,
 'spidermon/validation/validators/item/jsonschema': True,
 'spidermon_field_coverage/dict/brand': 1.0,
 'spidermon_field_coverage/dict/categories': 1.0,
 'spidermon_field_coverage/dict/countryOfOrigin': 1.0,
 'spidermon_field_coverage/dict/description': 1.0,
 'spidermon_field_coverage/dict/imageUrl': 1.0,
 'spidermon_field_coverage/dict/inStock': 1.0,
 'spidermon_field_coverage/dict/isFreeShipping': 1.0,
 'spidermon_field_coverage/dict/leadTime': 1.0,
 'spidermon_field_coverage/dict/manufacturer': 1.0,
 'spidermon_field_coverage/dict/manufacturerSku': 1.0,
 'spidermon_field_coverage/dict/name': 1.0,
 'spidermon_field_coverage/dict/packagingIncrement': 1.0,
 'spidermon_field_coverage/dict/prices': 1.0,
 'spidermon_field_coverage/dict/productStatus': 1.0,
 'spidermon_field_coverage/dict/relatedSkus': 1.0,
 'spidermon_field_coverage/dict/specifications': 1.0,
 'spidermon_field_coverage/dict/supplier': 1.0,
 'spidermon_field_coverage/dict/supplierSku': 1.0,
 'spidermon_field_coverage/dict/uom': 1.0,
 'spidermon_field_coverage/dict/url': 1.0,
 'spidermon_field_coverage/dict/weight': 1.0,
 'spidermon_item_scraped_count': 7042,
 'spidermon_item_scraped_count/dict': 7042,
 'spidermon_item_scraped_count/dict/brand': 7042,
 'spidermon_item_scraped_count/dict/categories': 7042,
 'spidermon_item_scraped_count/dict/countryOfOrigin': 7042,
 'spidermon_item_scraped_count/dict/description': 7042,
 'spidermon_item_scraped_count/dict/imageUrl': 7042,
 'spidermon_item_scraped_count/dict/inStock': 7042,
 'spidermon_item_scraped_count/dict/isFreeShipping': 7042,
 'spidermon_item_scraped_count/dict/leadTime': 7042,
 'spidermon_item_scraped_count/dict/manufacturer': 7042,
 'spidermon_item_scraped_count/dict/manufacturerSku': 7042,
 'spidermon_item_scraped_count/dict/name': 7042,
 'spidermon_item_scraped_count/dict/packagingIncrement': 7042,
 'spidermon_item_scraped_count/dict/prices': 7042,
 'spidermon_item_scraped_count/dict/productStatus': 7042,
 'spidermon_item_scraped_count/dict/relatedSkus': 7042,
 'spidermon_item_scraped_count/dict/specifications': 7042,
 'spidermon_item_scraped_count/dict/supplier': 7042,
 'spidermon_item_scraped_count/dict/supplierSku': 7042,
 'spidermon_item_scraped_count/dict/uom': 7042,
 'spidermon_item_scraped_count/dict/url': 7042,
 'spidermon_item_scraped_count/dict/weight': 7042,
 'start_requests/big_query': 22914,
 'start_time': datetime.datetime(2026, 1, 10, 17, 0, 9, 627782, tzinfo=datetime.timezone.utc)}
2026-01-10 21:00:20 [scrapy.core.engine] (PID: 62) INFO: Spider closed (closespider_timeout_no_item)